-- Logs begin at Sat 2022-07-30 20:01:15 UTC, end at Sat 2022-07-30 22:32:17 UTC. -- Jul 30 20:50:37.919169 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Jul 30 20:50:41.378404 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=123835) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 20:50:41.379380 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=123835) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 20:50:41.808839 ncdv-master-1 cinder-volume[123835]: INFO dbcounter [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Registered counter for database cinder Jul 30 20:50:41.828634 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_db.sqlalchemy.engines [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:50:41.835115 ncdv-master-1 cinder-volume[123835]: DEBUG dbcounter [-] [123835] Writer thread running {{(pid=123835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:50:42.035568 ncdv-master-1 cinder-volume[123835]: INFO cinder.rpc [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 20:50:42.040136 ncdv-master-1 cinder-volume[123835]: INFO cinder.rpc [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 20:50:42.048262 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_db.sqlalchemy.engines [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:50:42.212847 ncdv-master-1 cinder-volume[123835]: INFO cinder.volume.manager [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Determined volume DB was empty at startup. Jul 30 20:50:42.212847 ncdv-master-1 cinder-volume[123835]: DEBUG cinder.volume.manager [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=123835) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Jul 30 20:50:42.221064 ncdv-master-1 cinder-volume[123835]: INFO cinder.volume.manager [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 30 20:50:42.221866 ncdv-master-1 cinder-volume[123835]: WARNING stevedore.named [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 20:50:42.222308 ncdv-master-1 cinder-volume[123835]: WARNING castellan.key_manager [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 20:50:42.223496 ncdv-master-1 cinder-volume[123835]: WARNING cinder.keymgr.conf_key_mgr [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 20:50:42.240834 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_db.sqlalchemy.engines [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:50:42.246132 ncdv-master-1 cinder-volume[123835]: INFO cinder.rpc [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 30 20:50:42.250683 ncdv-master-1 cinder-volume[123835]: INFO cinder.rpc [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Jul 30 20:50:42.251370 ncdv-master-1 cinder-volume[123835]: WARNING stevedore.named [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 20:50:42.251931 ncdv-master-1 cinder-volume[123835]: WARNING castellan.key_manager [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 20:50:42.253828 ncdv-master-1 cinder-volume[123835]: INFO cinder.volume.manager [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Image-volume cache enabled for host ncdv-master-1@ceph. Jul 30 20:50:42.259796 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_db.sqlalchemy.engines [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:50:42.280042 ncdv-master-1 cinder-volume[123835]: INFO oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Starting 1 workers Jul 30 20:50:42.285433 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Started child 124008 {{(pid=123835) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jul 30 20:50:42.286441 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Full set of CONF: {{(pid=123835) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jul 30 20:50:42.286802 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ******************************************************************************** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 20:50:42.287117 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] Configuration options gathered from: {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 20:50:42.287596 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 20:50:42.288196 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 20:50:42.288480 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ================================================================================ {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 20:50:42.289410 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] allow_availability_zone_fallback = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.290079 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] allow_compression_on_image_upload = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.290894 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] allowed_direct_url_schemes = [] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.292000 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] api_rate_limit = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.292630 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] auth_strategy = keystone {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.293246 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] az_cache_duration = 3600 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.293801 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_availability_zone = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.294361 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_host = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.294891 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_name = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.295092 ncdv-master-1 cinder-volume[124008]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0) Jul 30 20:50:42.296066 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_stats_polling_interval = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.296466 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backup_api_class = cinder.backup.api.API {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.298929 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.298929 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backup_name_template = backup-%s {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.298929 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backup_use_same_host = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.298929 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backup_use_temp_snapshot = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.298929 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] chap_password = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.298929 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] chap_username = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.299539 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.299676 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cinder_internal_tenant_project_id = ec96772eef284ab3913f9628b136be7a {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.300211 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cinder_internal_tenant_user_id = 1656aa416bc146f486e71517e476773a {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.300725 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cloned_volume_same_az = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.301398 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cluster = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.302198 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] compression_format = gzip {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.302788 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] compute_api_class = cinder.compute.nova.API {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.303401 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] config_dir = [] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.303868 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.304739 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] config_source = [] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.304848 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.305180 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] control_exchange = openstack {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.305816 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] debug = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.306384 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] default_availability_zone = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.306991 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] default_group_type = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.308399 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.309129 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] default_volume_type = ceph {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.310400 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] driver_client_cert = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.311645 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] driver_client_cert_key = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.312529 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] driver_data_namespace = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.313345 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] driver_ssl_cert_path = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.314185 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] driver_ssl_cert_verify = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.314791 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] driver_use_ssl = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.315390 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] enable_force_upload = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.315932 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] enable_new_services = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.316494 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] enable_unsupported_driver = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.316999 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] enabled_backends = ['ceph'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.317454 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] enforce_multipath_for_image_xfer = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.317905 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] filter_function = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.318574 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] glance_api_insecure = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.319146 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] glance_api_servers = ['http://10.222.0.17/image'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.319769 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] glance_api_ssl_compression = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.320344 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] glance_ca_certificates_file = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.320924 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] glance_catalog_info = image:glance:publicURL {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.321633 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] glance_certfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.322590 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.323167 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] glance_keyfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.323763 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] glance_num_retries = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.324379 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] glance_request_timeout = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.324929 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] goodness_function = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.325654 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] graceful_shutdown_timeout = 5 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.326253 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] group_api_class = cinder.group.api.API {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.326794 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] host = ncdv-master-1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.493168 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] iet_conf = /etc/iet/ietd.conf {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.493168 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] image_compress_on_upload = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.493168 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] image_conversion_address_space_limit = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.493168 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] image_conversion_cpu_limit = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.493168 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.493168 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] image_conversion_disable = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495334 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] image_upload_use_cinder_backend = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495334 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] image_upload_use_internal_tenant = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495334 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] image_volume_cache_enabled = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495334 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] image_volume_cache_max_count = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495334 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] image_volume_cache_max_size_gb = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495334 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] init_host_max_objects_retrieval = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495334 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] instance_format = [instance: %(uuid)s] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495920 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495920 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] iscsi_iotype = fileio {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495920 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] iscsi_secondary_ip_addresses = [] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495920 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] iscsi_target_flags = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495920 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] iscsi_write_cache = on {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495920 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] iser_helper = tgtadm {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.495920 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] iser_ip_address = 10.222.0.17 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.496686 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] iser_port = 3260 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.496686 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.496686 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] log_config_append = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.496686 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.496686 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] log_dir = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.496686 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] log_file = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.497197 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] log_options = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.497293 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Starting volume driver RBDDriver (1.2.0) Jul 30 20:50:42.497414 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] log_rotate_interval = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.497414 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] log_rotate_interval_type = days {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.497414 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] log_rotation_type = none {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.497414 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.497414 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.498085 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.498085 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.498085 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.498309 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:50:42.498405 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] max_age = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.498405 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] max_logfile_count = 30 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.498405 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] max_logfile_size_mb = 200 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.498405 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] max_over_subscription_ratio = 20.0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.498405 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] message_reap_interval = 86400 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.498405 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] message_ttl = 2592000 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.498405 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] migration_create_volume_timeout_secs = 300 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499033 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] monkey_patch = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499033 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] monkey_patch_modules = [] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499033 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] my_ip = 10.222.0.17 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499033 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] no_snapshot_gb_quota = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499033 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] num_iser_scan_tries = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499033 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] num_shell_tries = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499033 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] num_volume_device_scan_tries = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499634 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] nvmet_ns_id = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499634 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] nvmet_port_id = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499634 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] osapi_max_limit = 1000 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499634 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] osapi_volume_ext_list = [] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499634 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.499634 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] osapi_volume_listen = 0.0.0.0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500095 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] osapi_volume_listen_port = 8776 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500095 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] osapi_volume_use_ssl = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500095 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] osapi_volume_workers = 2 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500095 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] per_volume_size_limit = -1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500095 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] periodic_fuzzy_delay = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500095 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] periodic_interval = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500095 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] project_id_regex = [0-9a-f\-]+ {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500650 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] public_endpoint = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500650 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] publish_errors = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500650 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] quota_backup_gigabytes = 1000 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500650 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] quota_backups = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500650 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] quota_consistencygroups = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500650 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.500650 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] quota_gigabytes = 1000 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501194 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] quota_groups = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501194 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] quota_snapshots = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501194 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] quota_volumes = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501194 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] rate_limit_burst = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501194 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] rate_limit_except_level = CRITICAL {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501194 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] rate_limit_interval = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501194 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] reinit_driver_count = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501719 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] replication_device = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501719 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] report_discard_supported = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501719 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] report_interval = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501719 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] reservation_clean_interval = 86400 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501719 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] reservation_expire = 86400 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501719 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] reserved_percentage = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.501719 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.502594 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.502594 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] rpc_response_timeout = 120 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.502594 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] run_external_periodic_tasks = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.502594 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.502594 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] scst_target_driver = iscsi {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.502594 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] scst_target_iqn_name = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503081 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_down_time = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503081 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] snapshot_name_template = snapshot-%s {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503081 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] snapshot_same_host = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503081 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] split_loggers = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503081 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] state_path = /opt/stack/data/cinder {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503081 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] storage_availability_zone = nova {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503081 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] storage_protocol = iSCSI {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503679 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] syslog_log_facility = LOG_USER {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503679 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] target_helper = lioadm {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503679 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] target_ip_address = 10.222.0.17 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503679 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] target_port = 3260 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503679 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.503679 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] target_protocol = iscsi {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504157 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] trace_flags = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504157 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] transfer_api_class = cinder.transfer.api.API {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504157 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] transport_url = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504157 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] until_refresh = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504157 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] use_chap_auth = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504157 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] use_default_quota_class = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504157 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] use_eventlog = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504640 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] use_journal = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504640 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] use_json = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504640 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] use_multipath_for_image_xfer = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504640 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] use_stderr = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504640 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] use_syslog = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504640 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] verify_glance_signatures = enabled {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.504640 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_api_class = cinder.volume.api.API {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505175 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_backend_name = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505175 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_clear = zero {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505175 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_clear_ionice = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505175 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_clear_size = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505175 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505175 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_copy_bps_limit = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505175 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_dd_blocksize = 1M {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505698 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505698 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_name_template = volume-%s {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505698 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_service_inithost_offload = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505698 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volume_usage_audit_period = month {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505698 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.505698 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] watch_log_file = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.506147 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] zoning_mode = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 20:50:42.506147 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.506147 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.506147 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_concurrency.disable_process_locking = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.506147 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.506147 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.506633 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.506633 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.506633 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.506633 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.506633 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.admin_password = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.506633 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507121 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.admin_token = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507121 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.admin_user = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507121 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.auth_admin_prefix = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507121 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507121 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.auth_port = 35357 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507121 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.auth_protocol = https {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507121 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.auth_section = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507804 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.auth_type = password {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507804 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.auth_uri = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507804 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.auth_version = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507804 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.cache = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507804 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.507804 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.certfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508263 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.delay_auth_decision = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508263 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508263 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.http_connect_timeout = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508263 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508263 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.identity_uri = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508263 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.include_service_catalog = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508692 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.insecure = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508692 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.interface = public {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508692 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.keyfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508692 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508692 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.508692 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509173 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509173 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509173 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509173 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509173 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509173 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509648 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.region_name = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509648 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509648 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.service_token_roles_required = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509648 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.service_type = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509648 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.token_cache_time = 300 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.509648 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510100 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.backend = dogpile.cache.null {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510189 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:50:42.510270 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.backend_argument = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510270 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.config_prefix = cache.oslo {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510270 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.dead_timeout = 60.0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510270 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.debug_cache_backend = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510270 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.enable_retry_client = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510270 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.enable_socket_keepalive = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510270 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.enabled = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510798 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.expiration_time = 600 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510798 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.hashclient_retry_attempts = 2 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510798 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.hashclient_retry_delay = 1.0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510798 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.memcache_dead_retry = 300 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510798 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510798 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.510798 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.memcache_pool_maxsize = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511364 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511364 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511364 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.memcache_socket_timeout = 1.0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511364 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.proxies = [] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511364 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.retry_attempts = 2 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511364 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.retry_delay = 0.0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511364 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.socket_keepalive_count = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511912 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.socket_keepalive_idle = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511912 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.socket_keepalive_interval = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511912 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.tls_allowed_ciphers = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511912 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.tls_cafile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511912 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.tls_certfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511912 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.tls_enabled = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.511912 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cache.tls_keyfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.512440 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] coordination.backend_url = etcd3+http://10.222.0.17:2379 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.512440 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.backend = sqlalchemy {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.512440 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.connection = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.512440 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.connection_debug = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.512440 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.connection_parameters = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.512440 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.connection_recycle_time = 3600 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.512440 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.connection_trace = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513036 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.db_inc_retry_interval = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513036 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.db_max_retries = 20 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513036 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.db_max_retry_interval = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513036 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.db_retry_interval = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513036 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.max_overflow = 50 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513036 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.max_pool_size = 5 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513036 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.max_retries = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513783 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.mysql_enable_ndb = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513783 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513783 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.pool_timeout = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513783 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.retry_interval = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513783 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.slave_connection = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513783 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.sqlite_synchronous = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.513783 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] database.use_db_reconnect = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.514792 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_policy.enforce_new_defaults = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.514792 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_policy.enforce_scope = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.514792 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_policy.policy_default_rule = default {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.514792 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.514792 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_policy.policy_file = policy.yaml {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.514792 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516133 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516133 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516133 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516133 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516133 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] profiler.connection_string = messaging:// {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516133 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] profiler.enabled = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516953 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] profiler.es_doc_type = notification {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516953 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] profiler.es_scroll_size = 10000 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516953 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] profiler.es_scroll_time = 2m {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516953 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] profiler.filter_error_trace = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516953 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] profiler.hmac_keys = SECRET_KEY {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516953 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] profiler.sentinel_service_name = mymaster {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.516953 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] profiler.socket_timeout = 0.1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.518246 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] profiler.trace_sqlalchemy = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.518246 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] os_brick.lock_path = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.518246 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] privsep_osbrick.capabilities = [21] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.518246 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] privsep_osbrick.group = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.518246 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] privsep_osbrick.helper_command = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.518246 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.518246 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.522471 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] privsep_osbrick.user = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.522471 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.522471 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cinder_sys_admin.group = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.522471 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cinder_sys_admin.helper_command = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.522471 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.522471 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.522471 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] cinder_sys_admin.user = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.523520 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_user.auth_section = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.523520 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_user.auth_type = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.523520 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_user.cafile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.523520 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_user.certfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.523520 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_user.collect_timing = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.523520 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_user.insecure = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.523520 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_user.keyfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.524499 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_user.send_service_user_token = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.524499 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_user.split_loggers = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.524499 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] service_user.timeout = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.524499 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.backend_availability_zone = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.524499 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.524499 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525240 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.chap_password = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525240 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.chap_username = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525240 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525240 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525240 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525240 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.driver_client_cert = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525750 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.driver_client_cert_key = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525750 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.driver_data_namespace = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525750 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525750 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525750 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.driver_use_ssl = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.525750 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.enable_deferred_deletion = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526218 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.enable_unsupported_driver = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526218 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526218 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.extra_capabilities = {} {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526218 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.filter_function = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526218 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.goodness_function = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526218 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526681 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526681 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526681 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526681 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526681 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.526681 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.iscsi_iotype = fileio {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527180 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527180 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.iscsi_target_flags = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527180 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.iscsi_write_cache = on {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527180 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.iser_helper = tgtadm {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527180 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.iser_ip_address = 10.222.0.17 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527180 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.iser_port = 3260 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527701 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527701 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527701 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527701 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.num_shell_tries = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527701 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.527701 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528135 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.nvmet_port_id = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528218 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:50:42.528306 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rados_connect_timeout = -1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528306 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rados_connection_interval = 5 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528306 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rados_connection_retries = 3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528306 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rbd_ceph_conf = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528306 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rbd_cluster_name = ceph {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528306 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528844 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528844 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528844 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rbd_pool = rbd {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528844 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rbd_secret_uuid = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528844 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.528844 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.rbd_user = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.529313 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.replication_connect_timeout = 5 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.529313 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.replication_device = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.529313 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.report_discard_supported = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.529313 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.529313 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.reserved_percentage = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.529313 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.scst_target_driver = iscsi {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.529796 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.scst_target_iqn_name = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.529895 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.driver [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Driver hasn't implemented _init_vendor_properties() Jul 30 20:50:42.529982 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.storage_protocol = iSCSI {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530067 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.driver [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:48ff4353-db26-438b-9f54-5e325bcdd5eb:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=124008) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}} Jul 30 20:50:42.530183 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530183 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.target_helper = tgtadm {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530183 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.target_ip_address = 10.222.0.17 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530183 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.target_port = 3260 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530183 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530183 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.target_protocol = iscsi {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530635 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.trace_flags = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530635 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.unique_fqdn_network = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530635 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.use_chap_auth = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530635 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530635 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.volume_backend_name = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.530635 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.volume_clear = zero {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.531112 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.volume_clear_ionice = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.531112 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.volume_clear_size = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.531112 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.531112 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.531112 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.531112 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.531834 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.531834 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_reports.file_event_handler = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.531834 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.532179 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_db.sqlalchemy.engines [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124008) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 20:50:42.532321 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_reports.log_dir = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.532321 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.backend_availability_zone = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.532579 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.backend_host = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.532917 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.backend_native_threads_pool_size = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.533661 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.backup_use_temp_snapshot = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.534018 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.chap_password = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.534491 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.chap_username = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.535013 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.chiscsi_conf = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.535387 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.deferred_deletion_delay = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.535705 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writer thread running {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 20:50:42.535978 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.deferred_deletion_purge_interval = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.536395 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.driver_client_cert = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.536757 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.driver_client_cert_key = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.537202 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.driver_data_namespace = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.537476 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.driver_ssl_cert_path = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.537850 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.driver_ssl_cert_verify = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.538349 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.driver_use_ssl = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.538957 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.enable_deferred_deletion = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.542539 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.enable_unsupported_driver = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.542539 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.542539 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.extra_capabilities = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.542539 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.filter_function = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.542539 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.goodness_function = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.542539 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.iet_conf = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.542539 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.image_upload_use_cinder_backend = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.543838 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.image_upload_use_internal_tenant = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.543838 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.image_volume_cache_enabled = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.544573 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.image_volume_cache_max_count = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.545511 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.image_volume_cache_max_size_gb = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.545884 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.iscsi_iotype = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.546549 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.547178 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.iscsi_target_flags = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.547596 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.iscsi_write_cache = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.547955 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.iser_helper = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.548306 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.iser_ip_address = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.548655 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.iser_port = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.549002 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.iser_target_prefix = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.549348 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.max_over_subscription_ratio = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.549819 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.num_iser_scan_tries = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.550168 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.num_shell_tries = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.550514 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.num_volume_device_scan_tries = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.550867 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.nvmet_ns_id = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.551376 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.nvmet_port_id = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.551761 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rados_connect_timeout = -1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.552361 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rados_connection_interval = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.553024 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rados_connection_retries = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.553406 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.553779 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rbd_cluster_name = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.554129 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.554503 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.555320 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rbd_max_clone_depth = 5 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.555692 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rbd_pool = volumes {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.556163 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rbd_secret_uuid = 25108750-09ba-4fb8-b2b1-158df8723c2e {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.556630 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rbd_store_chunk_size = 4 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.557051 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.rbd_user = cinder {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.557894 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.replication_connect_timeout = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.558286 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.replication_device = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.558637 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.report_discard_supported = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.558985 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.report_dynamic_total_capacity = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.559358 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.reserved_percentage = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.559711 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.scst_target_driver = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.560087 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.scst_target_iqn_name = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.560454 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.storage_protocol = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.560826 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.suppress_requests_ssl_warnings = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.562204 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.target_helper = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.562819 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.target_ip_address = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.563183 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.target_port = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.563555 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.target_prefix = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.564000 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.target_protocol = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.564354 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.trace_flags = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.564699 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.unique_fqdn_network = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.565469 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.use_chap_auth = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.565829 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.use_multipath_for_image_xfer = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.566434 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.volume_backend_name = ceph {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.566812 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.volume_clear = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.567601 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.volume_clear_ionice = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.567951 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.volume_clear_size = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.568303 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.568658 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.volume_copy_bps_limit = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.569001 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.volume_dd_blocksize = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.569369 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.569712 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ceph.volumes_dir = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.570152 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.570519 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.570899 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.571246 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.571672 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.572043 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.572936 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.573290 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.573834 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.574205 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.574323 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.db.sqlalchemy.api [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Building query based on filter {{(pid=124008) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}} Jul 30 20:50:42.574575 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.574944 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.576171 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.576786 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.577197 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.578175 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.578625 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.578989 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.579359 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.579720 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.580070 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.580427 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.580776 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.581146 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.581505 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.581959 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.ssl = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.582393 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.583010 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.583450 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.583978 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.584349 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_rabbit.ssl_version = {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.584682 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_notifications.driver = [] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.585510 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_notifications.retry = -1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.585949 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.586328 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] oslo_messaging_notifications.transport_url = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.586882 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.587184 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] key_manager.fixed_key = **** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.587645 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.587988 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.barbican_api_version = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.588649 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.barbican_endpoint = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.589041 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.barbican_endpoint_type = public {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.589783 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.barbican_region_name = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.590206 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.cafile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.590721 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.certfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.591137 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.collect_timing = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.591547 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.insecure = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.591924 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.keyfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.592760 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.number_of_retries = 60 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.593283 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.retry_delay = 1 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.593779 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.send_service_user_token = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.594316 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.split_loggers = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.594676 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.timeout = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.595028 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.verify_ssl = True {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.595419 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican.verify_ssl_path = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.595627 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.image_utils [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=124008) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}} Jul 30 20:50:42.595777 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican_service_user.auth_section = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.596287 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican_service_user.auth_type = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.597018 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican_service_user.cafile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.597520 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican_service_user.certfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.598016 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican_service_user.collect_timing = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.598507 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican_service_user.insecure = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.599137 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican_service_user.keyfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.599670 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican_service_user.split_loggers = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.600635 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] barbican_service_user.timeout = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.601453 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.approle_role_id = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.601962 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.approle_secret_id = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.602455 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.cafile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.603455 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.certfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.604485 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.collect_timing = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.605424 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.insecure = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.605934 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.keyfile = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.606909 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.kv_mountpoint = secret {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.607444 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.kv_version = 2 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.607957 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.namespace = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.608449 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.root_token_id = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.608872 ncdv-master-1 cinder-volume[124008]: INFO cinder.keymgr.migration [None req-56b24843-f02a-4faf-b91e-237d1e5a83a7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 20:50:42.609118 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.split_loggers = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.609756 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.ssl_ca_crt_file = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.610620 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.timeout = None {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.610942 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:50:42.611270 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.use_ssl = False {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.611808 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 20:50:42.612256 ncdv-master-1 cinder-volume[123835]: DEBUG oslo_service.service [None req-93e2a8e9-564e-4697-bd78-50e364059d8c None None] ******************************************************************************** {{(pid=123835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 20:50:42.655047 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:50:42.689545 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 20:50:42.724358 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Driver initialization completed successfully. Jul 30 20:50:42.724972 ncdv-master-1 cinder-volume[124008]: INFO cinder.manager [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Initiating service 3 cleanup Jul 30 20:50:42.738610 ncdv-master-1 cinder-volume[124008]: INFO cinder.manager [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Service 3 cleanup completed. Jul 30 20:50:42.738965 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.service [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Creating RPC server for service cinder-volume {{(pid=124008) start /opt/stack/cinder/cinder/service.py:238}} Jul 30 20:50:42.748303 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.service [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=124008) start /opt/stack/cinder/cinder/service.py:244}} Jul 30 20:50:42.819326 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Jul 30 20:50:42.820664 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:50:42.854983 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:50:42.915627 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3b2fe101-90e7-47a2-838a-78e6b7b05d25 None None] Driver post RPC initialization completed successfully. Jul 30 20:50:52.273638 ncdv-master-1 cinder-volume[123835]: DEBUG dbcounter [-] [123835] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=123835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:52.744246 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=20,cinder:INSERT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:50:52.912572 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:02.933547 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:22.919748 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:32.929520 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:51:52.928806 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:02.941300 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:15.918925 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 20:52:15.919733 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:52:15.944184 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:52:15.991085 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 20:52:22.935131 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:22.943149 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:42.940004 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:52:52.949978 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:53:12.937984 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:53:15.919068 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 20:53:15.919804 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:53:15.940813 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:53:15.962757 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 20:53:22.942357 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:53:42.948292 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:53:52.955796 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:54:12.962912 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:54:15.918286 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 20:54:15.919058 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:54:15.944838 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:54:15.984475 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 20:54:22.972730 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:54:32.974498 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:54:52.977830 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:55:12.978843 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:55:15.920849 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 20:55:15.921543 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:55:15.943738 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:55:15.965068 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 20:55:22.989257 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:55:42.989919 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:55:53.000194 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:56:13.000926 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:56:15.920232 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 20:56:15.920893 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:56:15.942155 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:56:15.974393 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 20:56:33.007574 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:56:43.010924 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:57:03.017969 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:57:13.027953 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:57:15.919506 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 20:57:15.920183 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:57:15.943681 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:57:15.967899 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 20:57:33.027896 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:57:33.029541 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:57:53.026046 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:58:03.034409 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:58:15.923098 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 20:58:15.923813 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:58:15.946291 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:58:15.975226 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 20:58:23.035405 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:58:43.042025 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:58:53.050690 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:59:13.052153 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:59:15.920121 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 20:59:15.920838 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:59:15.946547 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 20:59:15.969481 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 20:59:33.061116 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 20:59:43.064087 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:03.064315 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:15.924356 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:00:15.925022 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:00:15.971610 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:00:16.034650 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:00:23.076827 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:33.078448 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:43.094291 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:00:53.089202 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:15.922811 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:01:15.923652 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:01:16.008057 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:01:16.081625 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:01:23.089014 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:33.105303 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:01:53.093973 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:03.092750 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:15.926690 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:02:15.928853 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:02:16.027108 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:02:16.106744 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:02:33.088227 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:43.091635 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:02:53.111154 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:15.931362 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:03:15.931362 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:03:16.000037 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:03:16.107142 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:03:23.088109 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:33.177859 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:03:33.197551 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:03:33.254248 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Flow 'volume_create_manager' (425d1103-c300-41e3-b1cc-426513f26063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:03:33.260131 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd96d06-9639-4140-b4dc-4c45530a9a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:33.308105 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd96d06-9639-4140-b4dc-4c45530a9a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1615984419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b14e292-b0ad-49a1-ba5a-6437832e1a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc4b787c95143c0b9d6f53832e324f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:03:33Z,use_quota=True,user_id='f8b35ab211584884a72057fa31184836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:33.313340 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e01783-edf7-4d42-88ce-ebec9069eabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:33.317057 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e01783-edf7-4d42-88ce-ebec9069eabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:33.321511 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0f692d-f315-4477-8291-afeae4b8db49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:33.325342 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0f692d-f315-4477-8291-afeae4b8db49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b14e292-b0ad-49a1-ba5a-6437832e1a7b', 'volume_name': 'volume-1b14e292-b0ad-49a1-ba5a-6437832e1a7b', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:33.329644 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccac791-0e60-4f91-b3fb-b3e59d9daffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:33.333228 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccac791-0e60-4f91-b3fb-b3e59d9daffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:33.337430 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e9c005-89ce-442c-8834-c1c62bd3fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:33.338473 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Volume 1b14e292-b0ad-49a1-ba5a-6437832e1a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b14e292-b0ad-49a1-ba5a-6437832e1a7b', 'volume_size': 1} Jul 30 21:03:33.338885 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] creating volume 'volume-1b14e292-b0ad-49a1-ba5a-6437832e1a7b' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:03:33.339711 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:03:33.509432 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:03:33.509818 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:03:33.513785 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e9c005-89ce-442c-8834-c1c62bd3fe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b14e292-b0ad-49a1-ba5a-6437832e1a7b', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:33.518496 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bd7673-5ca0-4eb8-b9c2-732f043067a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:33.530688 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Volume volume-1b14e292-b0ad-49a1-ba5a-6437832e1a7b (1b14e292-b0ad-49a1-ba5a-6437832e1a7b): created successfully Jul 30 21:03:33.534421 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bd7673-5ca0-4eb8-b9c2-732f043067a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:33.540091 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Flow 'volume_create_manager' (425d1103-c300-41e3-b1cc-426513f26063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:03:33.552006 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-288e9d93-737d-424c-bbaf-e76c9c24e086 tempest-VolumesAdminNegativeTest-632897816 None] Created volume successfully. Jul 30 21:03:35.270095 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-181798df-d061-4e31-a1f8-1d0b52a43fda req-b48f7877-c2f0-4168-8ea7-20bafe4bdbaa tempest-VolumesAdminNegativeTest-632897816 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:03:36.454697 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-181798df-d061-4e31-a1f8-1d0b52a43fda req-b48f7877-c2f0-4168-8ea7-20bafe4bdbaa tempest-VolumesAdminNegativeTest-632897816 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.184s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:03:36.456598 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-181798df-d061-4e31-a1f8-1d0b52a43fda req-b48f7877-c2f0-4168-8ea7-20bafe4bdbaa tempest-VolumesAdminNegativeTest-632897816 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1b14e292-b0ad-49a1-ba5a-6437832e1a7b', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '1b14e292-b0ad-49a1-ba5a-6437832e1a7b', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:03:36.542988 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-181798df-d061-4e31-a1f8-1d0b52a43fda req-b48f7877-c2f0-4168-8ea7-20bafe4bdbaa tempest-VolumesAdminNegativeTest-632897816 None] Connection info returned from driver {'name': 'volumes/volume-1b14e292-b0ad-49a1-ba5a-6437832e1a7b', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1b14e292-b0ad-49a1-ba5a-6437832e1a7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '26c18927-2768-4815-9e7e-824dff2924bf'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:03:36.667435 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-181798df-d061-4e31-a1f8-1d0b52a43fda req-b48f7877-c2f0-4168-8ea7-20bafe4bdbaa tempest-VolumesAdminNegativeTest-632897816 None] attachment_update completed successfully. Jul 30 21:03:41.608935 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:03:41.641064 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Flow 'volume_create_manager' (7e8b87a5-99ca-4ce5-bc0c-87880156c648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:03:41.659913 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c474a765-14da-4c27-a7a5-f76785bf8f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:41.714652 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c474a765-14da-4c27-a7a5-f76785bf8f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1859267204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=86ac0138-c1aa-493c-88f1-f53c793d7a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fb262c72e0468e92246bf31d93a204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:03:42Z,use_quota=True,user_id='96815c6776f1464a8b6350b4a52d4548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:41.724409 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d70355c-f526-423b-abbb-2c094858da43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:41.728859 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d70355c-f526-423b-abbb-2c094858da43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:41.734781 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee941cf-78bf-416f-8dfe-5ec4ae56c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:41.739025 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee941cf-78bf-416f-8dfe-5ec4ae56c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ac0138-c1aa-493c-88f1-f53c793d7a32', 'volume_name': 'volume-86ac0138-c1aa-493c-88f1-f53c793d7a32', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:41.745160 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e84186-cd8a-400e-8f7d-e6d7397172d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:41.749859 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e84186-cd8a-400e-8f7d-e6d7397172d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:41.758357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026747b4-06a7-4b1f-88ad-2118be8b1a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:41.760321 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Volume 86ac0138-c1aa-493c-88f1-f53c793d7a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ac0138-c1aa-493c-88f1-f53c793d7a32', 'volume_size': 1} Jul 30 21:03:41.761052 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] creating volume 'volume-86ac0138-c1aa-493c-88f1-f53c793d7a32' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:03:41.761984 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:03:41.905064 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:03:41.905827 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:03:41.918088 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026747b4-06a7-4b1f-88ad-2118be8b1a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ac0138-c1aa-493c-88f1-f53c793d7a32', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:41.925223 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b45ce6-dd5f-4fba-943d-72bdefff78ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:41.943210 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Volume volume-86ac0138-c1aa-493c-88f1-f53c793d7a32 (86ac0138-c1aa-493c-88f1-f53c793d7a32): created successfully Jul 30 21:03:41.947849 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b45ce6-dd5f-4fba-943d-72bdefff78ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:41.989454 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Flow 'volume_create_manager' (7e8b87a5-99ca-4ce5-bc0c-87880156c648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:03:42.024171 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-42bf67dd-f326-45ae-9a26-b24cdc069f02 tempest-LiveMigrationTest-774293737 None] Created volume successfully. Jul 30 21:03:42.858788 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-2cab95ac-cd7a-4a3d-85ad-bd1a3b7dcead req-ef899d1f-f14d-4fd1-adc5-ee247d7af526 tempest-VolumesAdminNegativeTest-632897816 None] Terminate volume connection completed successfully. Jul 30 21:03:42.859938 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-2cab95ac-cd7a-4a3d-85ad-bd1a3b7dcead req-ef899d1f-f14d-4fd1-adc5-ee247d7af526 tempest-VolumesAdminNegativeTest-632897816 None] Deleting attachment 26c18927-2768-4815-9e7e-824dff2924bf. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:03:43.416593 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 req-6c5f1604-30bb-41d6-8e18-adf16917e819 tempest-LiveMigrationTest-774293737 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:03:45.156204 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 req-6c5f1604-30bb-41d6-8e18-adf16917e819 tempest-LiveMigrationTest-774293737 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.744s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:03:45.160851 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 req-6c5f1604-30bb-41d6-8e18-adf16917e819 tempest-LiveMigrationTest-774293737 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-86ac0138-c1aa-493c-88f1-f53c793d7a32', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '86ac0138-c1aa-493c-88f1-f53c793d7a32', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:03:45.203628 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 req-6c5f1604-30bb-41d6-8e18-adf16917e819 tempest-LiveMigrationTest-774293737 None] Connection info returned from driver {'name': 'volumes/volume-86ac0138-c1aa-493c-88f1-f53c793d7a32', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '86ac0138-c1aa-493c-88f1-f53c793d7a32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3b2e7d66-157a-47cb-b5ef-78543c7756e1'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:03:45.309479 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-fc6bae1d-3e1c-4148-8192-eaa3012746e8 req-6c5f1604-30bb-41d6-8e18-adf16917e819 tempest-LiveMigrationTest-774293737 None] attachment_update completed successfully. Jul 30 21:03:54.402709 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-c2efe2e0-b61d-404a-9484-8daf76a2d465 req-d14b8a42-7881-4c2f-a0db-083b08951e96 tempest-LiveMigrationTest-1705367644 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:03:55.177044 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-c2efe2e0-b61d-404a-9484-8daf76a2d465 req-d14b8a42-7881-4c2f-a0db-083b08951e96 tempest-LiveMigrationTest-1705367644 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.774s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:03:55.177834 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-c2efe2e0-b61d-404a-9484-8daf76a2d465 req-d14b8a42-7881-4c2f-a0db-083b08951e96 tempest-LiveMigrationTest-1705367644 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-86ac0138-c1aa-493c-88f1-f53c793d7a32', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '86ac0138-c1aa-493c-88f1-f53c793d7a32', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:03:55.203585 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-c2efe2e0-b61d-404a-9484-8daf76a2d465 req-d14b8a42-7881-4c2f-a0db-083b08951e96 tempest-LiveMigrationTest-1705367644 None] Connection info returned from driver {'name': 'volumes/volume-86ac0138-c1aa-493c-88f1-f53c793d7a32', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '86ac0138-c1aa-493c-88f1-f53c793d7a32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '64a8ad4a-53ae-40c1-ba35-59b537326909'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:03:55.263964 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-c2efe2e0-b61d-404a-9484-8daf76a2d465 req-d14b8a42-7881-4c2f-a0db-083b08951e96 tempest-LiveMigrationTest-1705367644 None] attachment_update completed successfully. Jul 30 21:03:55.629784 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:03:55.649765 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Flow 'volume_create_manager' (6784d0a4-f0ae-4dad-9cde-98e446b3c147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:03:55.656681 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c667c0-80a5-47f9-88a2-e1fd30a5136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:55.672148 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c667c0-80a5-47f9-88a2-e1fd30a5136e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-380018659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ef5d39c0-6fcc-4989-9a8e-f153d1d721ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb74be507694713821cb1a68619f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:03:56Z,use_quota=True,user_id='46d7264a2f63436bb8519cd8cec6d9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:55.677237 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f61b34-abfc-43ac-98af-8108bf67bd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:55.681128 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f61b34-abfc-43ac-98af-8108bf67bd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:55.685946 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca494ea-2cba-4902-97dd-5a6897e53d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:55.689785 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca494ea-2cba-4902-97dd-5a6897e53d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'volume_name': 'volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:55.694406 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365bf859-679d-4821-a5e7-4d98e8665879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:55.698125 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365bf859-679d-4821-a5e7-4d98e8665879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:55.703068 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0229516-0d66-4c37-88a7-d28e8bbbedc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:55.704114 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Volume ef5d39c0-6fcc-4989-9a8e-f153d1d721ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'volume_size': 1} Jul 30 21:03:55.704511 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] creating volume 'volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:03:55.705258 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:03:55.768246 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:03:55.768635 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:03:55.772501 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0229516-0d66-4c37-88a7-d28e8bbbedc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:55.777214 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa704d61-d122-45ec-bc3b-f128d07a7887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:03:55.786988 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Volume volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae (ef5d39c0-6fcc-4989-9a8e-f153d1d721ae): created successfully Jul 30 21:03:55.790520 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa704d61-d122-45ec-bc3b-f128d07a7887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:03:55.795916 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Flow 'volume_create_manager' (6784d0a4-f0ae-4dad-9cde-98e446b3c147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:03:55.806003 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-39d4137d-a49b-4599-8012-96f8caa0bb11 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Created volume successfully. Jul 30 21:03:57.186145 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-202d5fe8-e664-4052-83b7-c172a6897a05 req-63bbd4ac-fbd8-4eca-9fd6-b98622329264 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:03:57.938495 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-202d5fe8-e664-4052-83b7-c172a6897a05 req-63bbd4ac-fbd8-4eca-9fd6-b98622329264 tempest-LiveAutoBlockMigrationV225Test-948885521 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.752s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:03:57.939324 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-202d5fe8-e664-4052-83b7-c172a6897a05 req-63bbd4ac-fbd8-4eca-9fd6-b98622329264 tempest-LiveAutoBlockMigrationV225Test-948885521 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:03:57.964164 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-202d5fe8-e664-4052-83b7-c172a6897a05 req-63bbd4ac-fbd8-4eca-9fd6-b98622329264 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Connection info returned from driver {'name': 'volumes/volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd6484e10-c540-42fc-b179-9287a182898f'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:03:58.021165 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-202d5fe8-e664-4052-83b7-c172a6897a05 req-63bbd4ac-fbd8-4eca-9fd6-b98622329264 tempest-LiveAutoBlockMigrationV225Test-948885521 None] attachment_update completed successfully. Jul 30 21:04:03.284200 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=59,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:03.284879 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=65,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:03.301015 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:04:03.325848 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Flow 'volume_create_manager' (be554a71-59ff-4284-bfc6-5cefa23207c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:04:03.333558 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e60f51e-afb5-4c1a-8855-b0ea631b92a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:03.352000 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e60f51e-afb5-4c1a-8855-b0ea631b92a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-365581789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc4b787c95143c0b9d6f53832e324f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:04:03Z,use_quota=True,user_id='f8b35ab211584884a72057fa31184836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:03.357351 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061445ce-2864-4f5a-b7a1-9fe43bf18976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:03.361884 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061445ce-2864-4f5a-b7a1-9fe43bf18976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:03.366457 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc74bfd-3c71-4ef8-900c-616c2d72f7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:03.370778 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc74bfd-3c71-4ef8-900c-616c2d72f7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758', 'volume_name': 'volume-0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:03.377251 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2675d85-d85c-42af-99be-21563e34fedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:03.381520 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2675d85-d85c-42af-99be-21563e34fedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:03.386134 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ed4552-0ef2-4998-9bb6-0656c606bb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:03.387214 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Volume 0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758', 'volume_size': 1} Jul 30 21:04:03.387695 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] creating volume 'volume-0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:04:03.388952 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:03.456746 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:04:03.457527 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:04:03.461673 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ed4552-0ef2-4998-9bb6-0656c606bb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:03.467562 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71947519-6a81-4cd0-9813-221886cce40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:03.478551 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Volume volume-0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758 (0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758): created successfully Jul 30 21:04:03.483506 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71947519-6a81-4cd0-9813-221886cce40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:03.489820 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Flow 'volume_create_manager' (be554a71-59ff-4284-bfc6-5cefa23207c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:04:03.499803 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-26971edb-0737-4809-aa5d-e0a41528f302 tempest-VolumesAdminNegativeTest-632897816 None] Created volume successfully. Jul 30 21:04:04.522889 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] Acquiring lock "cinder-0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:04:04.548748 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] Lock "cinder-0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:04:04.632484 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:04.802333 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:04:04.814087 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] Volume volume-0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:04:04.857904 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] deleting rbd volume volume-0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:04:05.447778 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:04:05.449219 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:04:05.476976 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] Created reservations ['dfcc7ee7-fb8e-4e30-9f70-921afa3b0128', '1aff433b-db11-4326-9a78-3cf8ddf24ed4', 'b7fdbf5f-b71a-4fca-b6dc-9a6ebcb1c13a', '51bbacbc-e714-46b0-9c83-27e00aec240e'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:04:05.589522 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:05.697056 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:05.777026 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:04:05.789239 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] Deleted volume successfully. Jul 30 21:04:05.814305 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0866a9b4-e59e-4eac-86c0-571adb69667f tempest-VolumesAdminNegativeTest-632897816 None] Lock "cinder-0f6dd193-f5e4-4e5a-adb0-2d29e4ae3758-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:04:11.193899 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe req-a82fafb3-49b5-49a0-ae1c-561116c0fb82 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:04:11.238286 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-c2efe2e0-b61d-404a-9484-8daf76a2d465 req-2020fd7c-b636-4de8-b45b-63466a2cdf7f tempest-LiveMigrationTest-1705367644 None] Terminate volume connection completed successfully. Jul 30 21:04:11.239403 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-c2efe2e0-b61d-404a-9484-8daf76a2d465 req-2020fd7c-b636-4de8-b45b-63466a2cdf7f tempest-LiveMigrationTest-1705367644 None] Deleting attachment 3b2e7d66-157a-47cb-b5ef-78543c7756e1. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:04:12.285629 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe req-a82fafb3-49b5-49a0-ae1c-561116c0fb82 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.092s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:04:12.287267 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe req-a82fafb3-49b5-49a0-ae1c-561116c0fb82 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:04:12.329793 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe req-a82fafb3-49b5-49a0-ae1c-561116c0fb82 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] Connection info returned from driver {'name': 'volumes/volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ef5d39c0-6fcc-4989-9a8e-f153d1d721ae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '989f3b3b-9cca-43e9-9e36-c822c89c79a6'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:04:12.425268 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe req-a82fafb3-49b5-49a0-ae1c-561116c0fb82 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] attachment_update completed successfully. Jul 30 21:04:15.924476 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:04:15.926292 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:15.997283 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:16.069542 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:04:18.790390 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] Acquiring lock "cinder-1b14e292-b0ad-49a1-ba5a-6437832e1a7b-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:04:18.807158 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] Lock "cinder-1b14e292-b0ad-49a1-ba5a-6437832e1a7b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:04:18.865681 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:18.963249 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:04:18.963954 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] Volume volume-1b14e292-b0ad-49a1-ba5a-6437832e1a7b is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:04:18.974205 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] deleting rbd volume volume-1b14e292-b0ad-49a1-ba5a-6437832e1a7b {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:04:19.325504 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] Created reservations ['525ae7a7-5eea-4365-aa88-79d56993c6fa', '3470ffb3-0f71-4bef-b02f-2166c10d49e3', 'cbcf07ff-3d40-4877-a3f1-2e8cbba12674', 'fe203c8f-4bc7-4689-b629-d922f95fca06'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:04:19.389165 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:19.435792 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:19.479568 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:04:19.483677 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] Deleted volume successfully. Jul 30 21:04:19.499937 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-52c9e289-6e11-4d5c-bcf6-c5d2ca16fc20 tempest-VolumesAdminNegativeTest-632897816 None] Lock "cinder-1b14e292-b0ad-49a1-ba5a-6437832e1a7b-delete_volume" released by "delete_volume" :: held 0.696s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:04:21.708064 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-bdf6679e-d926-48ff-886d-93107f232e44 req-fe941e81-e4e6-48f4-b783-d6cee16337b1 tempest-LiveMigrationTest-774293737 None] Terminate volume connection completed successfully. Jul 30 21:04:21.708575 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-bdf6679e-d926-48ff-886d-93107f232e44 req-fe941e81-e4e6-48f4-b783-d6cee16337b1 tempest-LiveMigrationTest-774293737 None] Deleting attachment 64a8ad4a-53ae-40c1-ba35-59b537326909. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:04:21.783432 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe req-62693aa3-c678-42a4-a31b-79a36c169ccc tempest-LiveAutoBlockMigrationV225Test-1902217911 None] Terminate volume connection completed successfully. Jul 30 21:04:21.783853 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-0a9d929a-7a0d-4a34-a9c2-d7de602e89fe req-62693aa3-c678-42a4-a31b-79a36c169ccc tempest-LiveAutoBlockMigrationV225Test-1902217911 None] Deleting attachment d6484e10-c540-42fc-b179-9287a182898f. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:04:23.165621 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:04:23.186174 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Flow 'volume_create_manager' (626c72c6-e813-4640-b39c-87a6fcbde5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:04:23.193162 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103cc206-7cae-4372-ac2e-aa8848150e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:23.212908 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103cc206-7cae-4372-ac2e-aa8848150e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1092844368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1941c452-ad85-49ec-b06a-60721b5e727b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fb262c72e0468e92246bf31d93a204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:04:23Z,use_quota=True,user_id='96815c6776f1464a8b6350b4a52d4548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:23.220133 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3752039-a6b1-4de6-aec1-30677e8e3cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:23.224408 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3752039-a6b1-4de6-aec1-30677e8e3cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:23.229757 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47dbf457-962d-48b3-9c45-8a0404a2df7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:23.362834 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47dbf457-962d-48b3-9c45-8a0404a2df7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1941c452-ad85-49ec-b06a-60721b5e727b', 'volume_name': 'volume-1941c452-ad85-49ec-b06a-60721b5e727b', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:23.368931 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14574a5a-af19-4a33-a694-9be94a699148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:23.373110 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14574a5a-af19-4a33-a694-9be94a699148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:23.378487 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4da42d3-ef5b-4a5f-a68a-61bdd994e93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:23.380185 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Volume 1941c452-ad85-49ec-b06a-60721b5e727b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1941c452-ad85-49ec-b06a-60721b5e727b', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:04:23.380894 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Cloning 1941c452-ad85-49ec-b06a-60721b5e727b from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:04:23.381751 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:04:23.391027 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:04:23.403584 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Preparing cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:889}} Jul 30 21:04:23.403683 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:04:37.122664 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=58,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:37.147631 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=51,cinder:UPDATE=15,cinder:INSERT=6,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:04:37.159221 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-ea339a02-76e1-4ad7-8015-00a1986120ed req-45cf9912-ce86-4262-b15d-45e5e7a2da22 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Terminate volume connection completed successfully. Jul 30 21:04:37.159971 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-ea339a02-76e1-4ad7-8015-00a1986120ed req-45cf9912-ce86-4262-b15d-45e5e7a2da22 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Deleting attachment 989f3b3b-9cca-43e9-9e36-c822c89c79a6. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:04:38.718129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:04:38.745942 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Flow 'volume_create_manager' (1bdcc7a1-6e2d-42f7-9ed2-68236cfd405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:04:38.753265 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbe10ae-aa69-42aa-81c4-4b552f68ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:38.773526 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbe10ae-aa69-42aa-81c4-4b552f68ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-29267480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c0dfeefa-d76c-47b8-8db2-d0d74ae557ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb74be507694713821cb1a68619f9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:04:39Z,use_quota=True,user_id='46d7264a2f63436bb8519cd8cec6d9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:38.797393 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96294b5-889e-49ca-887f-5e155c732cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:38.806909 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96294b5-889e-49ca-887f-5e155c732cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:38.816473 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f7a378-614b-45a8-a25d-bf8c793c6028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:39.032491 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f7a378-614b-45a8-a25d-bf8c793c6028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'volume_name': 'volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:39.054270 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25195929-472a-404f-9228-48b9b28414e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:39.062153 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25195929-472a-404f-9228-48b9b28414e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:04:39.071362 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882c3dfe-e2ae-4ef0-a186-77b08fa1c2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:04:39.076268 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Volume c0dfeefa-d76c-47b8-8db2-d0d74ae557ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:04:39.077150 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Cloning c0dfeefa-d76c-47b8-8db2-d0d74ae557ed from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:04:39.077805 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:04:44.639324 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.image_utils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph, size 616.00 MB, duration 21.23 sec {{(pid=124008) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}} Jul 30 21:04:44.640218 ncdv-master-1 cinder-volume[124008]: INFO cinder.image.image_utils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Image download 616.00 MB at 29.02 MB/s Jul 30 21:04:44.687712 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:04:44.876156 ncdv-master-1 sudo[136643]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph Jul 30 21:04:44.882185 ncdv-master-1 sudo[136643]: pam_unix(sudo:session): session opened for user root by (uid=0) Jul 30 21:04:46.560636 ncdv-master-1 sudo[136643]: pam_unix(sudo:session): session closed for user root Jul 30 21:04:46.562700 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph" returned: 0 in 1.875s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:04:46.570806 ncdv-master-1 cinder-volume[124008]: WARNING py.warnings [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jul 30 21:04:46.570806 ncdv-master-1 cinder-volume[124008]: debtcollector.deprecate( Jul 30 21:04:46.570806 ncdv-master-1 cinder-volume[124008]: Jul 30 21:04:46.575087 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.image_utils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Temporary image 991d1dec-81bf-4a5b-923e-56f2270c6dfd is fetched for user 96815c6776f1464a8b6350b4a52d4548. {{(pid=124008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}} Jul 30 21:04:46.680821 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:04:46.816744 ncdv-master-1 sudo[136680]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph Jul 30 21:04:46.817757 ncdv-master-1 sudo[136680]: pam_unix(sudo:session): session opened for user root by (uid=0) Jul 30 21:04:48.733865 ncdv-master-1 sudo[136680]: pam_unix(sudo:session): session closed for user root Jul 30 21:04:48.735878 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph" returned: 0 in 2.055s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:04:48.736741 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] creating volume 'volume-1941c452-ad85-49ec-b06a-60721b5e727b' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:04:48.737925 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:48.911777 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:04:48.912405 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:04:48.937988 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Attempting download of 991d1dec-81bf-4a5b-923e-56f2270c6dfd ((None, None)) to volume 1941c452-ad85-49ec-b06a-60721b5e727b. {{(pid=124008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Jul 30 21:04:48.989804 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_991d1dec-81bf-4a5b-923e-56f2270c6dfd_yqard0o8 {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:04:49.109986 ncdv-master-1 sudo[136731]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_991d1dec-81bf-4a5b-923e-56f2270c6dfd_yqard0o8 Jul 30 21:04:49.110806 ncdv-master-1 sudo[136731]: pam_unix(sudo:session): session opened for user root by (uid=0) Jul 30 21:04:50.893293 ncdv-master-1 sudo[136731]: pam_unix(sudo:session): session closed for user root Jul 30 21:04:50.896548 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_991d1dec-81bf-4a5b-923e-56f2270c6dfd_yqard0o8" returned: 0 in 1.907s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:04:50.900297 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:04:51.134929 ncdv-master-1 sudo[136800]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph Jul 30 21:04:51.137503 ncdv-master-1 sudo[136800]: pam_unix(sudo:session): session opened for user root by (uid=0) Jul 30 21:04:53.177464 ncdv-master-1 sudo[136800]: pam_unix(sudo:session): session closed for user root Jul 30 21:04:53.179510 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph" returned: 0 in 2.279s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:04:53.180255 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.image_utils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] 991d1dec-81bf-4a5b-923e-56f2270c6dfd was vhdx, converting to raw {{(pid=124008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}} Jul 30 21:04:53.181287 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp9r0dqf6k {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:04:53.202677 ncdv-master-1 sudo[136842]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp9r0dqf6k Jul 30 21:04:53.203514 ncdv-master-1 sudo[136842]: pam_unix(sudo:session): session opened for user root by (uid=0) Jul 30 21:04:55.909428 ncdv-master-1 sudo[136842]: pam_unix(sudo:session): session closed for user root Jul 30 21:04:55.912089 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp9r0dqf6k" returned: 0 in 2.730s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:04:55.913862 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:04:56.039000 ncdv-master-1 sudo[136860]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph Jul 30 21:04:56.045198 ncdv-master-1 sudo[136860]: pam_unix(sudo:session): session opened for user root by (uid=0) Jul 30 21:04:58.243508 ncdv-master-1 sudo[136860]: pam_unix(sudo:session): session closed for user root Jul 30 21:04:58.247012 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph" returned: 0 in 2.332s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:04:58.248740 ncdv-master-1 cinder-volume[124008]: WARNING py.warnings [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jul 30 21:04:58.248740 ncdv-master-1 cinder-volume[124008]: debtcollector.deprecate( Jul 30 21:04:58.248740 ncdv-master-1 cinder-volume[124008]: Jul 30 21:04:58.249740 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.image_utils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_991d1dec-81bf-4a5b-923e-56f2270c6dfd_tz241agfncdv-master-1@ceph, size 700.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/conversion/tmp9r0dqf6k {{(pid=124008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}} Jul 30 21:04:58.250343 ncdv-master-1 cinder-volume[124008]: INFO cinder.image.image_utils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Converted 700.00 MB image at 256.18 MB/s Jul 30 21:04:58.252597 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:04:58.344140 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:04:58.344605 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:04:58.351551 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] deleting rbd volume volume-1941c452-ad85-49ec-b06a-60721b5e727b {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:04:58.773634 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp9r0dqf6k volume-1941c452-ad85-49ec-b06a-60721b5e727b --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:04:58.934192 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:04.965652 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp9r0dqf6k volume-1941c452-ad85-49ec-b06a-60721b5e727b --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 6.191s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:05:05.297671 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:05:05.514536 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:05:05.514883 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:05:05.515366 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Downloaded image 991d1dec-81bf-4a5b-923e-56f2270c6dfd ((None, None)) to volume 1941c452-ad85-49ec-b06a-60721b5e727b successfully. {{(pid=124008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}} Jul 30 21:05:05.585416 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.image_utils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Temporary image 991d1dec-81bf-4a5b-923e-56f2270c6dfd for user 96815c6776f1464a8b6350b4a52d4548 is deleted. {{(pid=124008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}} Jul 30 21:05:05.738727 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Created reservations ['a0c39e03-db70-4359-9469-57344205dbc8', 'e80d2c46-3c4e-45a8-bac0-66ef92f34a11', '1862687c-002d-4199-81aa-da2d1cac8330', '0230e88d-772f-430e-828c-ac3d1e104163'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:05:05.750334 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Creating image volume entry: {'provider_auth': None, 'display_name': 'image-991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_type_id': 'd439f1dc-772a-428f-8236-70686e2bf484', 'ec2_id': None, 'deleted': False, 'host': 'ncdv-master-1@ceph#ceph', 'bootable': False, 'group_id': None, 'previous_status': None, 'user_id': '96815c6776f1464a8b6350b4a52d4548', 'volume_admin_metadata': [], 'scheduled_at': datetime.datetime(2022, 7, 30, 21, 4, 23, tzinfo=datetime.timezone.utc), 'availability_zone': 'nova', 'encryption_key_id': None, 'metadata': {}, 'provider_location': None, 'size': 1, 'service_uuid': None, 'launched_at': None, 'consistencygroup_id': None, 'provider_id': None, 'terminated_at': None, 'volume_metadata': [], 'updated_at': datetime.datetime(2022, 7, 30, 21, 4, 23, tzinfo=datetime.timezone.utc), 'multiattach': False, 'created_at': datetime.datetime(2022, 7, 30, 21, 4, 23, tzinfo=datetime.timezone.utc), 'shared_targets': True, 'display_description': None, 'project_id': 'ec96772eef284ab3913f9628b136be7a', 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'provider_geometry': None, 'replication_status': None, 'replication_driver_data': None, 'deleted_at': None, 'cluster_name': None, 'replication_extended_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '1941c452-ad85-49ec-b06a-60721b5e727b'}. {{(pid=124008) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}} Jul 30 21:05:05.845048 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Volume reschedule parameters: False retry: None {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:05:05.873485 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Flow 'volume_create_manager' (d23aa732-4a20-4c6b-9f67-441d1c404d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:05:05.880178 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05aee146-9cfb-4496-932e-779158916484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:05:05.898647 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05aee146-9cfb-4496-932e-779158916484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='image-991d1dec-81bf-4a5b-923e-56f2270c6dfd',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e87262ec-313f-4770-82fa-2a4c46fee6ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec96772eef284ab3913f9628b136be7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1941c452-ad85-49ec-b06a-60721b5e727b,status='creating',terminated_at=None,updated_at=2022-07-30T21:04:23Z,use_quota=True,user_id='96815c6776f1464a8b6350b4a52d4548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:05:05.905590 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57166c18-0271-483c-8dec-7f4819b7b5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:05:05.910926 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57166c18-0271-483c-8dec-7f4819b7b5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:05:05.921410 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e6c6fa-f584-485d-b39b-04d35c3524bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:05:05.956856 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e6c6fa-f584-485d-b39b-04d35c3524bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'volume_name': 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca', 'volume_size': 1, 'source_volid': '1941c452-ad85-49ec-b06a-60721b5e727b', 'source_volstatus': 'downloading'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:05:05.962901 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7787c9f0-ec08-48d9-abfe-1e4b016ea924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:05:05.967695 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7787c9f0-ec08-48d9-abfe-1e4b016ea924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:05:05.976760 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7408d114-98c4-4b6f-874e-98f5cb9c6faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:05:05.978212 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Volume e87262ec-313f-4770-82fa-2a4c46fee6ca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca', 'volume_size': 1, 'source_volid': '1941c452-ad85-49ec-b06a-60721b5e727b', 'source_volstatus': 'downloading'} Jul 30 21:05:05.998323 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:05:06.124425 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] creating snapshot='volume-e87262ec-313f-4770-82fa-2a4c46fee6ca.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:05:06.406036 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] cloning 'volume-1941c452-ad85-49ec-b06a-60721b5e727b@volume-e87262ec-313f-4770-82fa-2a4c46fee6ca.clone_snap' to 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:05:06.553864 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:05:06.555464 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:05:06.555995 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:05:06.598072 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:05:06.602393 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7408d114-98c4-4b6f-874e-98f5cb9c6faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca', 'volume_size': 1, 'source_volid': '1941c452-ad85-49ec-b06a-60721b5e727b', 'source_volstatus': 'downloading'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:05:06.609730 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40e381f-df57-4805-9438-fa8d87333793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:05:06.628349 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Volume volume-e87262ec-313f-4770-82fa-2a4c46fee6ca (e87262ec-313f-4770-82fa-2a4c46fee6ca): created successfully Jul 30 21:05:06.638765 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40e381f-df57-4805-9438-fa8d87333793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:05:06.670716 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Flow 'volume_create_manager' (d23aa732-4a20-4c6b-9f67-441d1c404d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:05:06.706576 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Created volume successfully. Jul 30 21:05:06.788818 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Creating new image-volume cache entry for image 991d1dec-81bf-4a5b-923e-56f2270c6dfd on ncdv-master-1@ceph#ceph {{(pid=124008) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Jul 30 21:05:06.804234 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] New image-volume cache entry created: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 5, 6, 792735)}. {{(pid=124008) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Jul 30 21:05:06.813827 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 43.423s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:05:06.814324 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Marking volume 1941c452-ad85-49ec-b06a-60721b5e727b as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:05:06.827504 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to 1941c452-ad85-49ec-b06a-60721b5e727b. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:05:06.827957 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Creating volume glance metadata for volume 1941c452-ad85-49ec-b06a-60721b5e727b backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:05:06.965736 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4da42d3-ef5b-4a5f-a68a-61bdd994e93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1941c452-ad85-49ec-b06a-60721b5e727b', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:05:06.976806 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25cf035-972f-4854-b5e2-cbec16cd5c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:05:06.995639 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b (1941c452-ad85-49ec-b06a-60721b5e727b): created successfully Jul 30 21:05:07.003806 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25cf035-972f-4854-b5e2-cbec16cd5c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:05:07.023111 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Flow 'volume_create_manager' (626c72c6-e813-4640-b39c-87a6fcbde5ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:05:07.045004 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-d57ff14a-81e6-4934-a873-1196d60f85a0 tempest-LiveMigrationTest-774293737 None] Created volume successfully. Jul 30 21:05:07.713615 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 28.634s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:05:07.723537 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=48,cinder:UPDATE=14,cinder:INSERT=17,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:07.729565 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 5, 7, 718727)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:05:07.731254 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:05:07.731813 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:05:07.740151 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.027s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:05:07.741377 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:05:07.750038 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 5, 7, 746500)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:05:07.750960 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:05:07.750960 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:05:07.780712 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:05:07.888069 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] creating snapshot='volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:05:08.425164 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed.clone_snap' to 'volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:05:08.615835 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:05:08.617640 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:05:08.618750 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:05:08.641045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:05:08.642004 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Marking volume c0dfeefa-d76c-47b8-8db2-d0d74ae557ed as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:05:08.659439 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to c0dfeefa-d76c-47b8-8db2-d0d74ae557ed. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:05:08.660215 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Creating volume glance metadata for volume c0dfeefa-d76c-47b8-8db2-d0d74ae557ed backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:05:08.747129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882c3dfe-e2ae-4ef0-a186-77b08fa1c2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:05:08.752646 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b07141-6e71-47f3-9433-bd385cc661d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:05:08.765537 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Volume volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed (c0dfeefa-d76c-47b8-8db2-d0d74ae557ed): created successfully Jul 30 21:05:08.769903 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b07141-6e71-47f3-9433-bd385cc661d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:05:08.777955 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Flow 'volume_create_manager' (1bdcc7a1-6e2d-42f7-9ed2-68236cfd405c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:05:08.790778 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-ce468357-b350-41b1-8eff-ee37cc2253cd tempest-LiveAutoBlockMigrationV225Test-948885521 None] Created volume successfully. Jul 30 21:05:12.064777 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-468f0c24-8980-446d-b5bd-2854470410dc req-a593e364-6870-46e8-9074-32bab9d579f9 tempest-LiveMigrationTest-774293737 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:05:14.012240 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 req-f7a0a722-f4eb-4900-82e6-2be2e6df7784 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:05:14.183348 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-468f0c24-8980-446d-b5bd-2854470410dc req-a593e364-6870-46e8-9074-32bab9d579f9 tempest-LiveMigrationTest-774293737 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.118s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:05:14.184539 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-468f0c24-8980-446d-b5bd-2854470410dc req-a593e364-6870-46e8-9074-32bab9d579f9 tempest-LiveMigrationTest-774293737 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1941c452-ad85-49ec-b06a-60721b5e727b', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '1941c452-ad85-49ec-b06a-60721b5e727b', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:05:14.257538 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-468f0c24-8980-446d-b5bd-2854470410dc req-a593e364-6870-46e8-9074-32bab9d579f9 tempest-LiveMigrationTest-774293737 None] Connection info returned from driver {'name': 'volumes/volume-1941c452-ad85-49ec-b06a-60721b5e727b', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1941c452-ad85-49ec-b06a-60721b5e727b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7783459b-2375-48b3-9c7a-03da7337459d'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:05:14.345265 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=66,cinder:UPDATE=16,cinder:INSERT=16,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:14.378942 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-468f0c24-8980-446d-b5bd-2854470410dc req-a593e364-6870-46e8-9074-32bab9d579f9 tempest-LiveMigrationTest-774293737 None] attachment_update completed successfully. Jul 30 21:05:15.929275 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:05:15.930665 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:05:16.015470 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:05:16.100933 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:05:16.103436 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 req-f7a0a722-f4eb-4900-82e6-2be2e6df7784 tempest-LiveAutoBlockMigrationV225Test-948885521 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.093s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:05:16.104641 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 req-f7a0a722-f4eb-4900-82e6-2be2e6df7784 tempest-LiveAutoBlockMigrationV225Test-948885521 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:05:16.156860 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 req-f7a0a722-f4eb-4900-82e6-2be2e6df7784 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Connection info returned from driver {'name': 'volumes/volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5b5fdf60-0912-4af2-8fce-661c1aff293f'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:05:16.289265 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-85e98d4d-5c14-45fb-95e9-fa6eb5f14755 req-f7a0a722-f4eb-4900-82e6-2be2e6df7784 tempest-LiveAutoBlockMigrationV225Test-948885521 None] attachment_update completed successfully. Jul 30 21:05:33.103656 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=29,cinder:UPDATE=4,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:43.129556 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=14,cinder:UPDATE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:05:48.302952 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 req-6abd5e5c-5cf3-4584-9e43-03811a7d1c90 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:05:48.430431 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 req-55f313cf-efc1-44bd-8d37-410e60de7dd6 tempest-LiveMigrationTest-1705367644 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:05:50.493878 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 req-6abd5e5c-5cf3-4584-9e43-03811a7d1c90 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.192s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:05:50.495678 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 req-6abd5e5c-5cf3-4584-9e43-03811a7d1c90 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:05:50.537137 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 req-6abd5e5c-5cf3-4584-9e43-03811a7d1c90 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] Connection info returned from driver {'name': 'volumes/volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c0dfeefa-d76c-47b8-8db2-d0d74ae557ed', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f1d1ac08-efd1-4f83-a139-d6348f0ec6b8'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:05:50.631983 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 req-55f313cf-efc1-44bd-8d37-410e60de7dd6 tempest-LiveMigrationTest-1705367644 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.202s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:05:50.638271 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 req-55f313cf-efc1-44bd-8d37-410e60de7dd6 tempest-LiveMigrationTest-1705367644 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1941c452-ad85-49ec-b06a-60721b5e727b', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '1941c452-ad85-49ec-b06a-60721b5e727b', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:05:50.652772 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 req-6abd5e5c-5cf3-4584-9e43-03811a7d1c90 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] attachment_update completed successfully. Jul 30 21:05:50.689601 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 req-55f313cf-efc1-44bd-8d37-410e60de7dd6 tempest-LiveMigrationTest-1705367644 None] Connection info returned from driver {'name': 'volumes/volume-1941c452-ad85-49ec-b06a-60721b5e727b', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1941c452-ad85-49ec-b06a-60721b5e727b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'df28a9fb-018b-44a0-bb26-bd7a0909b5a9'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:05:50.864804 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 req-55f313cf-efc1-44bd-8d37-410e60de7dd6 tempest-LiveMigrationTest-1705367644 None] attachment_update completed successfully. Jul 30 21:05:59.288323 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 req-1b4b21e1-2b72-4df0-b314-a724439270e9 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] Terminate volume connection completed successfully. Jul 30 21:05:59.289840 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-7ac765c1-9c08-4d1a-a0aa-af90b4102de5 req-1b4b21e1-2b72-4df0-b314-a724439270e9 tempest-LiveAutoBlockMigrationV225Test-1902217911 None] Deleting attachment 5b5fdf60-0912-4af2-8fce-661c1aff293f. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:06:04.146998 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=37,cinder:UPDATE=6 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:04.176455 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 req-341ce31b-b7a4-419e-a9e0-a404bd6dc736 tempest-LiveMigrationTest-1705367644 None] Terminate volume connection completed successfully. Jul 30 21:06:04.178660 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-b3a5c27d-dbaa-4a79-9f7a-b9cc014887c0 req-341ce31b-b7a4-419e-a9e0-a404bd6dc736 tempest-LiveMigrationTest-1705367644 None] Deleting attachment 7783459b-2375-48b3-9c7a-03da7337459d. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:06:14.174477 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=26,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:15.931549 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:06:15.932526 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:16.024622 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:16.141435 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:06:27.102069 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-44195839-4aa6-4484-bb77-5176451cb5ab tempest-LiveMigrationTest-774293737 None] Terminate volume connection completed successfully. Jul 30 21:06:27.102824 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-44195839-4aa6-4484-bb77-5176451cb5ab tempest-LiveMigrationTest-774293737 None] Deleting attachment df28a9fb-018b-44a0-bb26-bd7a0909b5a9. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:06:27.293910 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] Acquiring lock "cinder-1941c452-ad85-49ec-b06a-60721b5e727b-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:06:27.311704 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] Lock "cinder-1941c452-ad85-49ec-b06a-60721b5e727b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:06:27.375198 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:27.506230 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:06:27.506625 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] volume has clone snapshot(s) {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1288}} Jul 30 21:06:27.508090 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:06:27.725556 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] Created reservations ['f7f0feaf-1309-4615-9231-2c28a10f9de7', '697f868d-8ac8-470a-bbb7-9da1edcb3162', 'b602ea68-143d-48d2-b0e7-651bfb7a4f15', '2b009c27-e744-4d99-a3dd-d20659175286'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:06:27.810162 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:27.903000 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:27.967390 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:06:27.974988 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] Deleted volume successfully. Jul 30 21:06:28.016810 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-540233eb-f9a1-46d7-9557-b8a14750a5d9 req-863b82ad-1bd1-4f04-b8c9-6a14be1046eb tempest-LiveMigrationTest-774293737 None] Lock "cinder-1941c452-ad85-49ec-b06a-60721b5e727b-delete_volume" released by "delete_volume" :: held 0.707s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:06:28.872035 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-0618102d-004e-4a07-ba68-82c3a0026647 req-6aa659cf-76da-49bd-a960-d69338614532 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Terminate volume connection completed successfully. Jul 30 21:06:28.872712 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-0618102d-004e-4a07-ba68-82c3a0026647 req-6aa659cf-76da-49bd-a960-d69338614532 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Deleting attachment f1d1ac08-efd1-4f83-a139-d6348f0ec6b8. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:06:29.045714 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Acquiring lock "cinder-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:06:29.070944 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Lock "cinder-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:06:29.150304 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:29.260804 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:06:29.281899 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] deleting rbd volume volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:06:29.757515 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:06:29.806234 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] deleting parent snapshot volume-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:06:30.565058 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] Acquiring lock "cinder-86ac0138-c1aa-493c-88f1-f53c793d7a32-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:06:30.571464 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Acquiring lock "cinder-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:06:30.587990 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Lock "cinder-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:06:30.598071 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] Lock "cinder-86ac0138-c1aa-493c-88f1-f53c793d7a32-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:06:30.686484 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:30.760577 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:06:30.761247 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Volume volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:06:30.774663 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] deleting rbd volume volume-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:06:30.779608 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:30.885967 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:06:30.886747 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] Volume volume-86ac0138-c1aa-493c-88f1-f53c793d7a32 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:06:30.911709 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] deleting rbd volume volume-86ac0138-c1aa-493c-88f1-f53c793d7a32 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:06:30.925352 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Created reservations ['1e2e8575-08e2-4f1b-ae4f-b5094a0a04e4', '4cf4d3da-d1cf-4d73-a084-c3b9824a0029', 'e1ed4dff-8bb7-4f96-8b41-8d16b635a702', '0a565014-9963-40ab-9770-1ba4431dccbe'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:06:31.090134 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:31.160391 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:31.219964 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:06:31.222958 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Deleted volume successfully. Jul 30 21:06:31.240298 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-0618102d-004e-4a07-ba68-82c3a0026647 req-a27cddc2-d60d-40b6-b741-02f0eab71748 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Lock "cinder-c0dfeefa-d76c-47b8-8db2-d0d74ae557ed-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:06:31.294432 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Created reservations ['e94e5e4d-f30b-4823-b078-10b65302460c', 'f8fd6a1c-518a-4400-ad42-1790ec2bb5c4', 'e063ba70-ca6f-48e6-9128-6c89eee281e3', '7256669e-8085-4e3b-a291-e698db74f6a3'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:06:31.385195 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:31.437797 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:31.491469 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:06:31.502072 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Deleted volume successfully. Jul 30 21:06:31.513822 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] Created reservations ['015bbc2a-9200-496f-8029-187d03efc807', 'b2bd775d-6eea-44e7-b07c-bd862ece56d8', '369c8205-330b-411c-b6ad-0f783308c574', 'bfbb2585-d03c-41ca-9720-b24d79f00533'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:06:31.540321 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=56,cinder:UPDATE=37,cinder:INSERT=7 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:31.548926 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d0b17b30-82fc-41f7-8916-16afed959711 tempest-LiveAutoBlockMigrationV225Test-948885521 None] Lock "cinder-ef5d39c0-6fcc-4989-9a8e-f153d1d721ae-delete_volume" released by "delete_volume" :: held 0.961s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:06:31.582756 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:31.627149 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:06:31.675039 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:06:31.686268 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] Deleted volume successfully. Jul 30 21:06:31.701994 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ea8eb3ac-56d5-4212-ba18-bd8e9b8f975e tempest-LiveMigrationTest-774293737 None] Lock "cinder-86ac0138-c1aa-493c-88f1-f53c793d7a32-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:06:43.103591 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:06:53.096851 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=60,cinder:UPDATE=26,cinder:INSERT=9,cinder:DELETE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:13.098551 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:15.934525 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:07:15.937979 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:07:16.042089 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:07:16.112078 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:07:23.097852 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:07:53.093118 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:03.105808 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:15.932325 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:08:15.933837 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:08:16.055832 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:08:16.160681 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:08:23.104748 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:33.099732 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:08:53.104384 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:03.113162 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:15.940411 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:09:15.941223 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:09:16.015802 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:09:16.090621 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:09:23.108089 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:43.114862 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:09:53.122252 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:03.122155 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:13.116394 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:15.938726 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:10:15.940267 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:10:15.989893 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:10:16.049693 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:10:18.801011 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:10:18.831467 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Flow 'volume_create_manager' (7a596685-4bbe-4093-bf46-b45782355598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:10:18.838157 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa720223-542e-4d5d-8dea-ae2a18e5551c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:18.870739 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa720223-542e-4d5d-8dea-ae2a18e5551c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1882372437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2cc1badd-c9dc-4e4e-80d7-47e2203c89a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7174018ac671484ab204d0ad1559d683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:10:19Z,use_quota=True,user_id='eb637624ed0f48c9b4ad60e2cda88eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:18.880598 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaefb87b-9b6b-4bbf-a19b-d59a2a15d2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:18.886133 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaefb87b-9b6b-4bbf-a19b-d59a2a15d2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:18.892042 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ca949f-5943-4aa9-bb2e-e7533ba9d099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:18.991031 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ca949f-5943-4aa9-bb2e-e7533ba9d099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2cc1badd-c9dc-4e4e-80d7-47e2203c89a3', 'volume_name': 'volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:18.997106 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ef6628-750b-44f7-9123-c899ba6e7deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:19.017769 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ef6628-750b-44f7-9123-c899ba6e7deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:19.022746 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed8f446-b0e2-4a3f-bda5-7b7ea40fe832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:19.024125 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Volume 2cc1badd-c9dc-4e4e-80d7-47e2203c89a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:10:19.024918 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Cloning 2cc1badd-c9dc-4e4e-80d7-47e2203c89a3 from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:10:19.025852 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:10:19.037110 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:10:19.070815 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 10, 19, 48237)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:10:19.071253 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:10:19.071707 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:10:19.078870 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.042s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:10:19.082063 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:10:19.089816 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 10, 19, 86635)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:10:19.090204 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:10:19.090610 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:10:19.104717 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:10:19.196385 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] creating snapshot='volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:10:20.059811 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3.clone_snap' to 'volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:10:20.285218 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:10:20.287351 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:10:20.288045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:10:20.316554 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:10:20.317506 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Marking volume 2cc1badd-c9dc-4e4e-80d7-47e2203c89a3 as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:10:20.327219 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to 2cc1badd-c9dc-4e4e-80d7-47e2203c89a3. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:10:20.327973 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Creating volume glance metadata for volume 2cc1badd-c9dc-4e4e-80d7-47e2203c89a3 backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:10:20.384361 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed8f446-b0e2-4a3f-bda5-7b7ea40fe832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:20.389198 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f399b4f-9c10-459b-a092-933f08d6bc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:20.399056 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Volume volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3 (2cc1badd-c9dc-4e4e-80d7-47e2203c89a3): created successfully Jul 30 21:10:20.402613 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f399b4f-9c10-459b-a092-933f08d6bc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:20.408372 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Flow 'volume_create_manager' (7a596685-4bbe-4093-bf46-b45782355598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:10:20.419478 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-745241b8-87d9-4533-9a22-5ef4953664a6 tempest-ServersTestBootFromVolume-340611875 None] Created volume successfully. Jul 30 21:10:24.626179 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-44539802-0572-41de-8052-8f9bcf4d98b7 req-d0b78956-70e9-4789-8568-f2e9a3011ba4 tempest-ServersTestBootFromVolume-340611875 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:10:26.869165 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-44539802-0572-41de-8052-8f9bcf4d98b7 req-d0b78956-70e9-4789-8568-f2e9a3011ba4 tempest-ServersTestBootFromVolume-340611875 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.243s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:10:26.870024 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-44539802-0572-41de-8052-8f9bcf4d98b7 req-d0b78956-70e9-4789-8568-f2e9a3011ba4 tempest-ServersTestBootFromVolume-340611875 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '2cc1badd-c9dc-4e4e-80d7-47e2203c89a3', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:10:26.909117 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-44539802-0572-41de-8052-8f9bcf4d98b7 req-d0b78956-70e9-4789-8568-f2e9a3011ba4 tempest-ServersTestBootFromVolume-340611875 None] Connection info returned from driver {'name': 'volumes/volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2cc1badd-c9dc-4e4e-80d7-47e2203c89a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '08d7a8e6-145c-4fb5-9074-cf895d428f3c'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:10:26.999801 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-44539802-0572-41de-8052-8f9bcf4d98b7 req-d0b78956-70e9-4789-8568-f2e9a3011ba4 tempest-ServersTestBootFromVolume-340611875 None] attachment_update completed successfully. Jul 30 21:10:37.027595 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=24,cinder:UPDATE=6,cinder:INSERT=8,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:37.045223 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:10:37.119632 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Flow 'volume_create_manager' (862006d8-b770-40c6-a4e3-8ee8a2ab0706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:10:37.142903 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fde8b8-7acb-465d-8dc8-70369b94f199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:37.214827 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fde8b8-7acb-465d-8dc8-70369b94f199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2078905506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d22ff22c-052a-42ef-9649-a89754fa834d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4c650076ad4077874a72f6e64461f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:10:37Z,use_quota=True,user_id='f00d46cd63d94b49abfa65d6106c7d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:37.228403 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ac3dcc-eff5-47bd-b407-7e4a13f40153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:37.238347 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ac3dcc-eff5-47bd-b407-7e4a13f40153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:37.249363 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9d823d-2c7f-4f0d-8b66-638fe9c8e3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:37.264001 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9d823d-2c7f-4f0d-8b66-638fe9c8e3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22ff22c-052a-42ef-9649-a89754fa834d', 'volume_name': 'volume-d22ff22c-052a-42ef-9649-a89754fa834d', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:37.268918 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abffda48-4974-4f38-8d20-82863e180628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:37.280263 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abffda48-4974-4f38-8d20-82863e180628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:37.296488 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b38dc2-f67d-45eb-aaaf-06a9a9746e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:37.297879 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Volume d22ff22c-052a-42ef-9649-a89754fa834d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22ff22c-052a-42ef-9649-a89754fa834d', 'volume_size': 1} Jul 30 21:10:37.299747 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] creating volume 'volume-d22ff22c-052a-42ef-9649-a89754fa834d' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:10:37.303622 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:10:37.444284 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:10:37.447817 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:10:37.453685 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b38dc2-f67d-45eb-aaaf-06a9a9746e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22ff22c-052a-42ef-9649-a89754fa834d', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:37.477305 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fd233c-b878-4b42-bf30-45597a468c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:37.511826 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Volume volume-d22ff22c-052a-42ef-9649-a89754fa834d (d22ff22c-052a-42ef-9649-a89754fa834d): created successfully Jul 30 21:10:37.521740 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fd233c-b878-4b42-bf30-45597a468c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:37.539605 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Flow 'volume_create_manager' (862006d8-b770-40c6-a4e3-8ee8a2ab0706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:10:37.557021 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-4461fcf0-d3ba-4c72-bbad-9160e45db1f8 tempest-AttachVolumeShelveTestJSON-1107471233 None] Created volume successfully. Jul 30 21:10:43.183814 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:10:43.228129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Flow 'volume_create_manager' (6649fe2d-6203-43d7-9684-143f3608fd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:10:43.236161 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25351d3d-9884-44d3-841a-26a26859697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:43.253050 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=46,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:10:43.284601 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25351d3d-9884-44d3-841a-26a26859697d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-425445391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=90f9f894-91c0-47f9-959a-1e5551ad4574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcec3648d3843dd96bfed76e793598a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:10:43Z,use_quota=True,user_id='879e94018c474c838b1b989f3d4013a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:43.296470 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e205a6b9-07d7-4cce-9480-f6882f602227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:43.305968 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e205a6b9-07d7-4cce-9480-f6882f602227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:43.311635 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c6cccf-6438-42c4-8485-79a3cba017b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:43.318405 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c6cccf-6438-42c4-8485-79a3cba017b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f9f894-91c0-47f9-959a-1e5551ad4574', 'volume_name': 'volume-90f9f894-91c0-47f9-959a-1e5551ad4574', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:43.334203 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326f0c61-5060-436d-b166-72ba65dad3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:43.372383 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326f0c61-5060-436d-b166-72ba65dad3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:43.389145 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df22c90-12e8-4e0d-bc86-78c15e2d432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:43.390600 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Volume 90f9f894-91c0-47f9-959a-1e5551ad4574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f9f894-91c0-47f9-959a-1e5551ad4574', 'volume_size': 1} Jul 30 21:10:43.392367 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] creating volume 'volume-90f9f894-91c0-47f9-959a-1e5551ad4574' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:10:43.395575 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:10:43.539563 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:10:43.540121 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:10:43.544174 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df22c90-12e8-4e0d-bc86-78c15e2d432e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f9f894-91c0-47f9-959a-1e5551ad4574', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:43.550788 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f672dec-8f3d-46a8-afeb-85ffb874d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:43.564925 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Volume volume-90f9f894-91c0-47f9-959a-1e5551ad4574 (90f9f894-91c0-47f9-959a-1e5551ad4574): created successfully Jul 30 21:10:43.569565 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f672dec-8f3d-46a8-afeb-85ffb874d28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:43.576674 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Flow 'volume_create_manager' (6649fe2d-6203-43d7-9684-143f3608fd26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:10:43.592804 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a0c3414d-10b4-4bd6-b6ca-dbbcda95ac40 tempest-AttachSCSIVolumeTestJSON-523155028 None] Created volume successfully. Jul 30 21:10:45.574463 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c req-1b97c25d-24a3-4a81-9fb0-05882b1eff08 tempest-AttachSCSIVolumeTestJSON-523155028 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:10:47.656919 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c req-1b97c25d-24a3-4a81-9fb0-05882b1eff08 tempest-AttachSCSIVolumeTestJSON-523155028 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.082s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:10:47.658409 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c req-1b97c25d-24a3-4a81-9fb0-05882b1eff08 tempest-AttachSCSIVolumeTestJSON-523155028 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-90f9f894-91c0-47f9-959a-1e5551ad4574', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '90f9f894-91c0-47f9-959a-1e5551ad4574', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:10:47.724790 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c req-1b97c25d-24a3-4a81-9fb0-05882b1eff08 tempest-AttachSCSIVolumeTestJSON-523155028 None] Connection info returned from driver {'name': 'volumes/volume-90f9f894-91c0-47f9-959a-1e5551ad4574', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '90f9f894-91c0-47f9-959a-1e5551ad4574', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9dd18bc4-2429-4dce-9d9e-31a9d6f0b87d'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:10:47.863431 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-3fc92c3b-8c9b-4418-a2a3-6129cbb2153c req-1b97c25d-24a3-4a81-9fb0-05882b1eff08 tempest-AttachSCSIVolumeTestJSON-523155028 None] attachment_update completed successfully. Jul 30 21:10:53.232903 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-61e6adb0-1397-409e-a645-592b139dda46 req-d4d32b4f-e0ca-4401-85ee-bb3e3765c687 tempest-AttachSCSIVolumeTestJSON-523155028 None] Terminate volume connection completed successfully. Jul 30 21:10:53.234873 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-61e6adb0-1397-409e-a645-592b139dda46 req-d4d32b4f-e0ca-4401-85ee-bb3e3765c687 tempest-AttachSCSIVolumeTestJSON-523155028 None] Deleting attachment 9dd18bc4-2429-4dce-9d9e-31a9d6f0b87d. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:10:59.642166 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:10:59.706826 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Flow 'volume_create_manager' (b9c99c25-cce2-4322-9740-2e23a148d713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:10:59.732276 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc8891e-b6d4-4f35-8964-b0a33add130d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:59.777482 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc8891e-b6d4-4f35-8964-b0a33add130d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-928725111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=614115ca-d5a6-460a-a6c0-928cfeb56502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef0a07428164b708be97eebe5547697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:11:00Z,use_quota=True,user_id='8b930b074300497fa17ae36dc074c586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:59.796858 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3a70f3-8822-46ea-b7d1-54fc2c33798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:59.805088 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3a70f3-8822-46ea-b7d1-54fc2c33798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:59.815732 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd246ef-d9a2-4a48-89ea-6228c9b8dac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:59.839410 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd246ef-d9a2-4a48-89ea-6228c9b8dac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '614115ca-d5a6-460a-a6c0-928cfeb56502', 'volume_name': 'volume-614115ca-d5a6-460a-a6c0-928cfeb56502', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:59.850745 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33fce72-4d96-487d-8f0b-fedce0d4bac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:59.858740 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33fce72-4d96-487d-8f0b-fedce0d4bac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:10:59.870641 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8862f2c5-1db1-4420-b116-9e9a3e565deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:10:59.883429 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Volume 614115ca-d5a6-460a-a6c0-928cfeb56502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-614115ca-d5a6-460a-a6c0-928cfeb56502', 'volume_size': 1} Jul 30 21:10:59.884098 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] creating volume 'volume-614115ca-d5a6-460a-a6c0-928cfeb56502' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:10:59.885055 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:11:00.042283 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:11:00.042678 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:11:00.046614 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8862f2c5-1db1-4420-b116-9e9a3e565deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614115ca-d5a6-460a-a6c0-928cfeb56502', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:00.067544 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f536cf9-4801-44fe-a34d-1974e75ee5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:00.088238 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Volume volume-614115ca-d5a6-460a-a6c0-928cfeb56502 (614115ca-d5a6-460a-a6c0-928cfeb56502): created successfully Jul 30 21:11:00.100286 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f536cf9-4801-44fe-a34d-1974e75ee5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:00.107250 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Flow 'volume_create_manager' (b9c99c25-cce2-4322-9740-2e23a148d713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:11:00.121919 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e8d7b38c-e32b-4dcc-95a1-eb6fd42759c8 tempest-ServerRescueNegativeTestJSON-115835355 None] Created volume successfully. Jul 30 21:11:09.337889 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] Acquiring lock "cinder-90f9f894-91c0-47f9-959a-1e5551ad4574-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:11:09.352324 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] Lock "cinder-90f9f894-91c0-47f9-959a-1e5551ad4574-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:11:09.361149 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=28,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:09.437071 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:11:09.532072 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:11:09.532666 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] Volume volume-90f9f894-91c0-47f9-959a-1e5551ad4574 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:11:09.543517 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] deleting rbd volume volume-90f9f894-91c0-47f9-959a-1e5551ad4574 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:11:10.111957 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] Created reservations ['59a4042d-bcd2-4112-b8a8-c38344189a94', '4eec2de3-a201-4bcc-b36f-6503639ae6b7', '90605f77-105b-46d0-8049-92e6a5cb389d', '8fc8580a-5895-41e2-aa64-7e4a855091d3'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:11:10.204578 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:11:10.257526 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:11:10.307109 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:11:10.318864 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] Deleted volume successfully. Jul 30 21:11:10.333627 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a235f94d-8c9a-4f02-9739-3de249693dbb tempest-AttachSCSIVolumeTestJSON-523155028 None] Lock "cinder-90f9f894-91c0-47f9-959a-1e5551ad4574-delete_volume" released by "delete_volume" :: held 0.980s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:11:15.937371 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:11:15.938143 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:11:16.009606 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:11:16.050013 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:11:23.127373 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=40,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:29.315452 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 req-6b47b1e9-6f4c-4664-bfb0-5a8aec612882 tempest-AttachVolumeShelveTestJSON-1107471233 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:11:30.302851 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 req-6b47b1e9-6f4c-4664-bfb0-5a8aec612882 tempest-AttachVolumeShelveTestJSON-1107471233 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.986s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:11:30.304207 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 req-6b47b1e9-6f4c-4664-bfb0-5a8aec612882 tempest-AttachVolumeShelveTestJSON-1107471233 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d22ff22c-052a-42ef-9649-a89754fa834d', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'd22ff22c-052a-42ef-9649-a89754fa834d', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:11:30.334622 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 req-6b47b1e9-6f4c-4664-bfb0-5a8aec612882 tempest-AttachVolumeShelveTestJSON-1107471233 None] Connection info returned from driver {'name': 'volumes/volume-d22ff22c-052a-42ef-9649-a89754fa834d', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd22ff22c-052a-42ef-9649-a89754fa834d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e60caa07-4d35-42a6-8c7e-356ff1ead553'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:11:30.405644 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-1f1eadb9-a43e-4c06-bdae-6799afb18a16 req-6b47b1e9-6f4c-4664-bfb0-5a8aec612882 tempest-AttachVolumeShelveTestJSON-1107471233 None] attachment_update completed successfully. Jul 30 21:11:30.753838 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:11:30.804382 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Flow 'volume_create_manager' (b3d8c360-2268-4e8e-8b83-07647aa798e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:11:30.811247 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7191f3c-5dd7-44df-9b39-c8788c5869df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:30.852579 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7191f3c-5dd7-44df-9b39-c8788c5869df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-971693580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1de790c2-b9e6-4af2-8872-5feb1eaf86f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef0a07428164b708be97eebe5547697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:11:31Z,use_quota=True,user_id='8b930b074300497fa17ae36dc074c586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:30.859732 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3dca13-990e-4469-a730-fbc6bde9236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:30.865922 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3dca13-990e-4469-a730-fbc6bde9236e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:30.873126 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1c2f20-e201-40a9-b1e7-59b3882ff829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:30.878915 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1c2f20-e201-40a9-b1e7-59b3882ff829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de790c2-b9e6-4af2-8872-5feb1eaf86f8', 'volume_name': 'volume-1de790c2-b9e6-4af2-8872-5feb1eaf86f8', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:30.885586 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c7b65e-5556-4b03-99b6-27ef3a5b659a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:30.891752 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c7b65e-5556-4b03-99b6-27ef3a5b659a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:30.897313 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f791a3b8-6a9e-47d0-80f9-86d5b881d298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:30.900584 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Volume 1de790c2-b9e6-4af2-8872-5feb1eaf86f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de790c2-b9e6-4af2-8872-5feb1eaf86f8', 'volume_size': 1} Jul 30 21:11:30.901089 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] creating volume 'volume-1de790c2-b9e6-4af2-8872-5feb1eaf86f8' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:11:30.902088 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:11:31.056427 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:11:31.056891 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:11:31.065019 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f791a3b8-6a9e-47d0-80f9-86d5b881d298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de790c2-b9e6-4af2-8872-5feb1eaf86f8', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:31.076076 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84e4114-d373-4cb4-aa41-b988943083a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:31.097001 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Volume volume-1de790c2-b9e6-4af2-8872-5feb1eaf86f8 (1de790c2-b9e6-4af2-8872-5feb1eaf86f8): created successfully Jul 30 21:11:31.105187 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84e4114-d373-4cb4-aa41-b988943083a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:31.113104 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Flow 'volume_create_manager' (b3d8c360-2268-4e8e-8b83-07647aa798e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:11:31.124125 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-304738a8-39d5-40fa-8d2d-f4ee8c1d7056 tempest-ServerRescueNegativeTestJSON-115835355 None] Created volume successfully. Jul 30 21:11:33.175568 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:11:33.206176 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Flow 'volume_create_manager' (0831367e-5559-495e-9d1d-e0e8170c5b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:11:33.219259 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42111eaa-6ec5-43cf-b66e-66007bf3b5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:33.241688 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42111eaa-6ec5-43cf-b66e-66007bf3b5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-158242442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f81f5558-43b4-4c6a-a9ba-6e695e56d674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0743c6764e9d487a9a3efa52e8e2b611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:11:33Z,use_quota=True,user_id='b839893e78134428a3cf451901129edc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:33.287459 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6279c91-5cbc-4c21-8a57-feee1dd785f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:33.306688 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6279c91-5cbc-4c21-8a57-feee1dd785f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:33.313558 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2603c2cd-2d19-4f0c-843c-8a0ec03a0acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:33.318702 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2603c2cd-2d19-4f0c-843c-8a0ec03a0acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81f5558-43b4-4c6a-a9ba-6e695e56d674', 'volume_name': 'volume-f81f5558-43b4-4c6a-a9ba-6e695e56d674', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:33.324384 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7b4d70-4b0a-4b1b-8ca3-8476f459f41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:33.328761 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7b4d70-4b0a-4b1b-8ca3-8476f459f41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:33.334926 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed1ade4-b5cc-42da-be1d-86177faf35da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:33.336482 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Volume f81f5558-43b4-4c6a-a9ba-6e695e56d674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81f5558-43b4-4c6a-a9ba-6e695e56d674', 'volume_size': 1} Jul 30 21:11:33.337042 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] creating volume 'volume-f81f5558-43b4-4c6a-a9ba-6e695e56d674' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:11:33.338476 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:11:33.464987 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:11:33.465800 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:11:33.473868 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed1ade4-b5cc-42da-be1d-86177faf35da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81f5558-43b4-4c6a-a9ba-6e695e56d674', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:33.493374 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a29273-8c05-451d-a2e8-36cdec11c7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:11:33.519777 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Volume volume-f81f5558-43b4-4c6a-a9ba-6e695e56d674 (f81f5558-43b4-4c6a-a9ba-6e695e56d674): created successfully Jul 30 21:11:33.525887 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a29273-8c05-451d-a2e8-36cdec11c7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:11:33.533699 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Flow 'volume_create_manager' (0831367e-5559-495e-9d1d-e0e8170c5b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:11:33.547954 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5edce349-e928-4727-94d3-67ec598e628d tempest-DeleteServersTestJSON-1715350511 None] Created volume successfully. Jul 30 21:11:35.084361 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-5369044a-cbed-450b-a9c0-35d63226d752 req-4ef93223-ad51-4cbc-8f72-226bfbefe027 tempest-DeleteServersTestJSON-1715350511 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:11:37.170485 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-5369044a-cbed-450b-a9c0-35d63226d752 req-4ef93223-ad51-4cbc-8f72-226bfbefe027 tempest-DeleteServersTestJSON-1715350511 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.086s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:11:37.171913 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-5369044a-cbed-450b-a9c0-35d63226d752 req-4ef93223-ad51-4cbc-8f72-226bfbefe027 tempest-DeleteServersTestJSON-1715350511 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f81f5558-43b4-4c6a-a9ba-6e695e56d674', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'f81f5558-43b4-4c6a-a9ba-6e695e56d674', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:11:37.245773 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-5369044a-cbed-450b-a9c0-35d63226d752 req-4ef93223-ad51-4cbc-8f72-226bfbefe027 tempest-DeleteServersTestJSON-1715350511 None] Connection info returned from driver {'name': 'volumes/volume-f81f5558-43b4-4c6a-a9ba-6e695e56d674', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f81f5558-43b4-4c6a-a9ba-6e695e56d674', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '85fa8b64-d37b-497c-914d-e5c23aecb336'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:11:37.361624 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-5369044a-cbed-450b-a9c0-35d63226d752 req-4ef93223-ad51-4cbc-8f72-226bfbefe027 tempest-DeleteServersTestJSON-1715350511 None] attachment_update completed successfully. Jul 30 21:11:43.126156 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=37,cinder:INSERT=2,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:11:43.981173 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-cd883313-816e-4a61-8bce-db5fba699531 req-18a45dc0-8f89-49fd-a136-bb8c54d67362 tempest-DeleteServersTestJSON-1715350511 None] Terminate volume connection completed successfully. Jul 30 21:11:43.983167 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-cd883313-816e-4a61-8bce-db5fba699531 req-18a45dc0-8f89-49fd-a136-bb8c54d67362 tempest-DeleteServersTestJSON-1715350511 None] Deleting attachment 85fa8b64-d37b-497c-914d-e5c23aecb336. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:12:03.126019 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=42,cinder:UPDATE=8 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:12.053966 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-ed54df28-c351-4b50-a802-054bae3e21c2 tempest-ServersTestBootFromVolume-340611875 None] Terminate volume connection completed successfully. Jul 30 21:12:12.055169 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-ed54df28-c351-4b50-a802-054bae3e21c2 tempest-ServersTestBootFromVolume-340611875 None] Deleting attachment 08d7a8e6-145c-4fb5-9074-cf895d428f3c. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:12:12.185310 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] Acquiring lock "cinder-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:12:12.201201 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] Lock "cinder-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:12:12.249011 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:12:12.379682 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:12:12.390584 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] deleting rbd volume volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:12:12.761297 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:12:12.812080 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] deleting parent snapshot volume-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:12:13.039982 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] Created reservations ['fc48ad58-5ec9-4d0a-991d-d02f746e0eef', 'a2140f35-d607-4150-b2e6-c53e105527e3', 'ae79d7a7-cc22-44b5-bd11-936baf6f690a', '288f1699-a7fc-460f-8599-ec1c1e5e30ee'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:12:13.112416 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:12:13.211348 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:12:13.281728 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:12:13.288081 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=19,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:13.291624 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] Deleted volume successfully. Jul 30 21:12:13.327564 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-e55035ab-340d-4fbd-b70a-c7c002d8fe45 req-085a0905-0a7c-4184-9ae7-fc61b7d79b30 tempest-ServersTestBootFromVolume-340611875 None] Lock "cinder-2cc1badd-c9dc-4e4e-80d7-47e2203c89a3-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:12:15.937430 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:12:15.938956 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:12:16.019996 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:12:16.103374 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:12:33.294380 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:43.557603 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:12:43.564831 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-f93c4d81-9d21-4522-bc64-f4a81cc709f2 req-c2cde15f-24a9-498d-afc4-e699bd162d80 tempest-AttachVolumeShelveTestJSON-1107471233 None] Terminate volume connection completed successfully. Jul 30 21:12:43.565264 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-f93c4d81-9d21-4522-bc64-f4a81cc709f2 req-c2cde15f-24a9-498d-afc4-e699bd162d80 tempest-AttachVolumeShelveTestJSON-1107471233 None] Deleting attachment e60caa07-4d35-42a6-8c7e-356ff1ead553. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:12:49.428579 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-c9841283-bd65-4c4a-a8f2-cca30158433a req-1d227dfd-629f-4d95-97d0-236dba04076e tempest-ServerRescueNegativeTestJSON-115835355 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:12:49.594030 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:12:49.669754 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Flow 'volume_create_manager' (75c4bb0f-2015-43cf-ad86-c65ea76e181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:12:49.714787 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcca61dc-2b49-4e8c-9cbe-23d0b080b88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:49.777630 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcca61dc-2b49-4e8c-9cbe-23d0b080b88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-504478583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=274b1600-813c-4727-aba9-36bcc9319a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2471207e4614f369934b1723545d1f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:12:50Z,use_quota=True,user_id='c4fc3f756d034b339878ee04f0469df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:49.803674 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f487dd51-2475-4ac6-b385-1bc1ba6b0be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:49.816522 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f487dd51-2475-4ac6-b385-1bc1ba6b0be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:49.825580 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b81db8-4b51-4897-9e7d-43f714e8a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:49.947025 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b81db8-4b51-4897-9e7d-43f714e8a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '274b1600-813c-4727-aba9-36bcc9319a0c', 'volume_name': 'volume-274b1600-813c-4727-aba9-36bcc9319a0c', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:49.953226 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e8f7e0-bc4e-4e97-bf88-91eec0ec9ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:49.957766 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e8f7e0-bc4e-4e97-bf88-91eec0ec9ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:49.963260 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5378a26-1f64-49ed-8541-34f7761ce533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:49.964639 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Volume 274b1600-813c-4727-aba9-36bcc9319a0c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-274b1600-813c-4727-aba9-36bcc9319a0c', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:12:49.965469 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Cloning 274b1600-813c-4727-aba9-36bcc9319a0c from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:12:49.966444 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:12:49.976711 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:12:50.001260 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 12, 49, 988602)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:12:50.003093 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:12:50.003846 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:12:50.031235 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.053s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:12:50.034574 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:12:50.049497 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 12, 50, 45886)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:12:50.050264 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:12:50.050979 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:12:50.067515 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:12:50.203658 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] creating snapshot='volume-274b1600-813c-4727-aba9-36bcc9319a0c.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:12:50.420566 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-274b1600-813c-4727-aba9-36bcc9319a0c.clone_snap' to 'volume-274b1600-813c-4727-aba9-36bcc9319a0c' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:12:50.690783 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:12:50.692045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:12:50.692368 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:12:50.748767 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:12:50.749457 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Marking volume 274b1600-813c-4727-aba9-36bcc9319a0c as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:12:50.761461 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to 274b1600-813c-4727-aba9-36bcc9319a0c. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:12:50.761890 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Creating volume glance metadata for volume 274b1600-813c-4727-aba9-36bcc9319a0c backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:12:50.885998 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5378a26-1f64-49ed-8541-34f7761ce533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274b1600-813c-4727-aba9-36bcc9319a0c', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:50.903605 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310ff58c-2219-4369-83a7-f5995b1d926d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:50.932671 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Volume volume-274b1600-813c-4727-aba9-36bcc9319a0c (274b1600-813c-4727-aba9-36bcc9319a0c): created successfully Jul 30 21:12:50.938036 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310ff58c-2219-4369-83a7-f5995b1d926d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:50.963172 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Flow 'volume_create_manager' (75c4bb0f-2015-43cf-ad86-c65ea76e181a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:12:50.993995 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e0a62938-82eb-4d15-a80b-8a296dae4c2c tempest-TaggedBootDevicesTest-1391871096 None] Created volume successfully. Jul 30 21:12:51.302498 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-c9841283-bd65-4c4a-a8f2-cca30158433a req-1d227dfd-629f-4d95-97d0-236dba04076e tempest-ServerRescueNegativeTestJSON-115835355 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.874s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:12:51.303115 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-c9841283-bd65-4c4a-a8f2-cca30158433a req-1d227dfd-629f-4d95-97d0-236dba04076e tempest-ServerRescueNegativeTestJSON-115835355 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1de790c2-b9e6-4af2-8872-5feb1eaf86f8', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '1de790c2-b9e6-4af2-8872-5feb1eaf86f8', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:12:51.362390 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-c9841283-bd65-4c4a-a8f2-cca30158433a req-1d227dfd-629f-4d95-97d0-236dba04076e tempest-ServerRescueNegativeTestJSON-115835355 None] Connection info returned from driver {'name': 'volumes/volume-1de790c2-b9e6-4af2-8872-5feb1eaf86f8', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1de790c2-b9e6-4af2-8872-5feb1eaf86f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fe8a6e46-70a7-419f-9139-ff23843c4170'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:12:51.501395 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-c9841283-bd65-4c4a-a8f2-cca30158433a req-1d227dfd-629f-4d95-97d0-236dba04076e tempest-ServerRescueNegativeTestJSON-115835355 None] attachment_update completed successfully. Jul 30 21:12:52.607931 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:12:52.672437 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Flow 'volume_create_manager' (bd335030-fff6-4d3f-b77b-55ba5f90c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:12:52.684996 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ed479e-dba0-4453-b4df-396ee59faa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:52.728371 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ed479e-dba0-4453-b4df-396ee59faa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-541914817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5bc23213-e140-4a12-b440-bd8f58b9cd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2471207e4614f369934b1723545d1f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:12:52Z,use_quota=True,user_id='c4fc3f756d034b339878ee04f0469df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:52.740316 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa87e154-9f7d-436f-9b79-a08c4a344744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:52.746990 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa87e154-9f7d-436f-9b79-a08c4a344744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:52.758825 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecafb174-d7c8-4a5d-afea-4435c47b4119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:52.772408 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecafb174-d7c8-4a5d-afea-4435c47b4119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc23213-e140-4a12-b440-bd8f58b9cd96', 'volume_name': 'volume-5bc23213-e140-4a12-b440-bd8f58b9cd96', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:52.787505 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f069853a-d4d2-4ae3-8c70-8a7d763bc8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:52.792688 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f069853a-d4d2-4ae3-8c70-8a7d763bc8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:52.798032 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6de12a1-93b0-426b-bed5-5afd9129a6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:52.813267 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Volume 5bc23213-e140-4a12-b440-bd8f58b9cd96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc23213-e140-4a12-b440-bd8f58b9cd96', 'volume_size': 1} Jul 30 21:12:52.815755 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] creating volume 'volume-5bc23213-e140-4a12-b440-bd8f58b9cd96' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:12:52.816787 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:12:52.985492 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:12:52.985860 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:12:52.990738 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6de12a1-93b0-426b-bed5-5afd9129a6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc23213-e140-4a12-b440-bd8f58b9cd96', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:53.018146 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c9fe9d-54fb-4530-a67d-ea2dcb4e9eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:53.044707 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Volume volume-5bc23213-e140-4a12-b440-bd8f58b9cd96 (5bc23213-e140-4a12-b440-bd8f58b9cd96): created successfully Jul 30 21:12:53.048292 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c9fe9d-54fb-4530-a67d-ea2dcb4e9eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:53.075824 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Flow 'volume_create_manager' (bd335030-fff6-4d3f-b77b-55ba5f90c68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:12:53.099479 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-23dc56ab-5ec8-4cef-8589-b0e47afa743c tempest-TaggedBootDevicesTest-1391871096 None] Created volume successfully. Jul 30 21:12:54.584466 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:12:54.608218 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Flow 'volume_create_manager' (6f9c5e8d-d353-4bcb-8b95-12d7f951b454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:12:54.616899 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd1d2a5-7e41-49c9-ad8f-869edd350e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:54.639348 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd1d2a5-7e41-49c9-ad8f-869edd350e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1784320962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=60fb4518-f854-4b61-a759-7d8ecb213f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2471207e4614f369934b1723545d1f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:12:55Z,use_quota=True,user_id='c4fc3f756d034b339878ee04f0469df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:54.645758 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e53d6d-9a6f-4d0e-b964-0b026e871571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:54.650856 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e53d6d-9a6f-4d0e-b964-0b026e871571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:54.657297 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519c9a27-0382-45f2-9e45-84791c29964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:54.668262 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519c9a27-0382-45f2-9e45-84791c29964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60fb4518-f854-4b61-a759-7d8ecb213f83', 'volume_name': 'volume-60fb4518-f854-4b61-a759-7d8ecb213f83', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:54.675225 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d6af6e-c1d4-4662-9f73-97886adce4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:54.679771 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d6af6e-c1d4-4662-9f73-97886adce4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:54.688131 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a587538-cfbd-41f6-980b-b2d47d23880d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:54.690470 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Volume 60fb4518-f854-4b61-a759-7d8ecb213f83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60fb4518-f854-4b61-a759-7d8ecb213f83', 'volume_size': 1} Jul 30 21:12:54.695836 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] creating volume 'volume-60fb4518-f854-4b61-a759-7d8ecb213f83' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:12:54.696594 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:12:54.837536 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:12:54.838513 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:12:54.844954 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a587538-cfbd-41f6-980b-b2d47d23880d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60fb4518-f854-4b61-a759-7d8ecb213f83', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:54.854926 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84b83dc-d06a-42cf-a38d-217f13300af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:12:54.878180 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Volume volume-60fb4518-f854-4b61-a759-7d8ecb213f83 (60fb4518-f854-4b61-a759-7d8ecb213f83): created successfully Jul 30 21:12:54.899859 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84b83dc-d06a-42cf-a38d-217f13300af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:12:54.927171 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Flow 'volume_create_manager' (6f9c5e8d-d353-4bcb-8b95-12d7f951b454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:12:54.940808 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2971c6b5-81f9-4728-8d74-facc6f62d7c2 tempest-TaggedBootDevicesTest-1391871096 None] Created volume successfully. Jul 30 21:13:13.303527 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=34,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:13.305665 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=44,cinder:UPDATE=12,cinder:INSERT=12,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:15.940195 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:13:15.941017 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:13:16.007625 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:13:16.084821 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:13:24.924322 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-5ca85839-b9cd-42d6-aad7-d52fe6ae0a2c tempest-TaggedBootDevicesTest-1391871096 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:13:26.856196 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-5ca85839-b9cd-42d6-aad7-d52fe6ae0a2c tempest-TaggedBootDevicesTest-1391871096 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.932s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:13:26.857757 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-5ca85839-b9cd-42d6-aad7-d52fe6ae0a2c tempest-TaggedBootDevicesTest-1391871096 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-274b1600-813c-4727-aba9-36bcc9319a0c', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '274b1600-813c-4727-aba9-36bcc9319a0c', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:13:27.042912 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-5ca85839-b9cd-42d6-aad7-d52fe6ae0a2c tempest-TaggedBootDevicesTest-1391871096 None] Connection info returned from driver {'name': 'volumes/volume-274b1600-813c-4727-aba9-36bcc9319a0c', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '274b1600-813c-4727-aba9-36bcc9319a0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '694fcda7-ff5d-4e85-b359-4e0daf629eff'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:13:27.292510 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-5ca85839-b9cd-42d6-aad7-d52fe6ae0a2c tempest-TaggedBootDevicesTest-1391871096 None] attachment_update completed successfully. Jul 30 21:13:28.064870 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-cacbe3c3-431c-4172-9fbf-8c1707a88fb3 tempest-TaggedBootDevicesTest-1391871096 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:13:30.056461 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-cacbe3c3-431c-4172-9fbf-8c1707a88fb3 tempest-TaggedBootDevicesTest-1391871096 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.991s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:13:30.057969 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-cacbe3c3-431c-4172-9fbf-8c1707a88fb3 tempest-TaggedBootDevicesTest-1391871096 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5bc23213-e140-4a12-b440-bd8f58b9cd96', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '5bc23213-e140-4a12-b440-bd8f58b9cd96', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:13:30.098422 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-cacbe3c3-431c-4172-9fbf-8c1707a88fb3 tempest-TaggedBootDevicesTest-1391871096 None] Connection info returned from driver {'name': 'volumes/volume-5bc23213-e140-4a12-b440-bd8f58b9cd96', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5bc23213-e140-4a12-b440-bd8f58b9cd96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f8d136a0-1ef7-422f-b75a-e692e259cb42'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:13:30.183397 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-cacbe3c3-431c-4172-9fbf-8c1707a88fb3 tempest-TaggedBootDevicesTest-1391871096 None] attachment_update completed successfully. Jul 30 21:13:30.638340 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-cb927485-bc04-4dba-a9f2-8d3a54be2313 tempest-TaggedBootDevicesTest-1391871096 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:13:32.364947 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-cb927485-bc04-4dba-a9f2-8d3a54be2313 tempest-TaggedBootDevicesTest-1391871096 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.726s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:13:32.365758 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-cb927485-bc04-4dba-a9f2-8d3a54be2313 tempest-TaggedBootDevicesTest-1391871096 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-60fb4518-f854-4b61-a759-7d8ecb213f83', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '60fb4518-f854-4b61-a759-7d8ecb213f83', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:13:32.430926 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-cb927485-bc04-4dba-a9f2-8d3a54be2313 tempest-TaggedBootDevicesTest-1391871096 None] Connection info returned from driver {'name': 'volumes/volume-60fb4518-f854-4b61-a759-7d8ecb213f83', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '60fb4518-f854-4b61-a759-7d8ecb213f83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd1a775f2-dd00-4d45-a280-8c1419ce7bdf'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:13:32.569363 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-3fc0408e-64b3-4782-abd5-b73948430f65 req-cb927485-bc04-4dba-a9f2-8d3a54be2313 tempest-TaggedBootDevicesTest-1391871096 None] attachment_update completed successfully. Jul 30 21:13:43.319723 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=33,cinder:UPDATE=7 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:53.321216 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=42,cinder:UPDATE=6 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:13:58.821199 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-96fd74fa-d994-4280-a340-d782cb00940a req-7568a021-38b3-44a7-9c9f-65c58b391e2a tempest-ServerRescueNegativeTestJSON-115835355 None] Terminate volume connection completed successfully. Jul 30 21:13:58.821796 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-96fd74fa-d994-4280-a340-d782cb00940a req-7568a021-38b3-44a7-9c9f-65c58b391e2a tempest-ServerRescueNegativeTestJSON-115835355 None] Deleting attachment fe8a6e46-70a7-419f-9139-ff23843c4170. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:14:03.652275 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:14:03.683686 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Flow 'volume_create_manager' (a455478e-7115-4505-b575-16dab596152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:14:03.690673 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa021b9-b375-4670-b23c-13f77cb11bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:03.710839 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa021b9-b375-4670-b23c-13f77cb11bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-134387367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4c650076ad4077874a72f6e64461f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:14:04Z,use_quota=True,user_id='f00d46cd63d94b49abfa65d6106c7d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:03.716871 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e41494-a225-471a-82ec-7814aea0ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:03.721478 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e41494-a225-471a-82ec-7814aea0ea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:03.729502 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064273a0-68fb-4b82-90f3-102eb033402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:03.735636 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064273a0-68fb-4b82-90f3-102eb033402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac', 'volume_name': 'volume-e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:03.741061 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a699b7-32be-4ec8-b1dd-fd357451ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:03.745284 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a699b7-32be-4ec8-b1dd-fd357451ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:03.752685 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2915d3da-9a5d-43c1-a0dc-33a8fd46c43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:03.754266 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Volume e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac', 'volume_size': 1} Jul 30 21:14:03.755370 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] creating volume 'volume-e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:14:03.756310 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:03.898518 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:14:03.899133 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:14:03.908072 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2915d3da-9a5d-43c1-a0dc-33a8fd46c43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:03.913020 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2cb136-55b4-4dd0-9b85-87c6bc790352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:03.929764 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Volume volume-e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac (e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac): created successfully Jul 30 21:14:03.935178 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2cb136-55b4-4dd0-9b85-87c6bc790352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:03.943172 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Flow 'volume_create_manager' (a455478e-7115-4505-b575-16dab596152a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:14:03.957762 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-79b19714-ffad-4af1-aabf-9c1f2b1a34ff tempest-AttachVolumeShelveTestJSON-1107471233 None] Created volume successfully. Jul 30 21:14:12.955555 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] Acquiring lock "cinder-1de790c2-b9e6-4af2-8872-5feb1eaf86f8-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:14:12.982073 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] Lock "cinder-1de790c2-b9e6-4af2-8872-5feb1eaf86f8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:14:13.021616 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:13.074387 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:14:13.074839 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] Volume volume-1de790c2-b9e6-4af2-8872-5feb1eaf86f8 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:14:13.083359 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] deleting rbd volume volume-1de790c2-b9e6-4af2-8872-5feb1eaf86f8 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:14:13.429189 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=18,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:13.463227 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] Created reservations ['dce3f169-925d-415f-b8b3-e7bcc0cd82ab', 'e682f3c6-27d5-45a4-8fd8-22c5f5413c44', '30e06ac1-9a15-4483-93e9-14f934ed9fe4', '37c116d0-f34c-4ea6-89c2-b11dfb7d569b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:14:13.584010 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:13.667208 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:13.737123 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:14:13.745369 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] Deleted volume successfully. Jul 30 21:14:13.781803 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-73ada216-720e-4e31-8d54-330fed4e8156 tempest-ServerRescueNegativeTestJSON-115835355 None] Lock "cinder-1de790c2-b9e6-4af2-8872-5feb1eaf86f8-delete_volume" released by "delete_volume" :: held 0.799s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:14:14.168923 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] Acquiring lock "cinder-614115ca-d5a6-460a-a6c0-928cfeb56502-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:14:14.195154 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] Lock "cinder-614115ca-d5a6-460a-a6c0-928cfeb56502-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:14:14.279714 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:14.363078 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:14:14.363709 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] Volume volume-614115ca-d5a6-460a-a6c0-928cfeb56502 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:14:14.369209 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] deleting rbd volume volume-614115ca-d5a6-460a-a6c0-928cfeb56502 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:14:14.810199 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] Created reservations ['78b1deb0-198b-4016-bbb2-ab9372e3eea3', 'feb11021-7bca-4024-926f-0a4dfd4f0a12', 'd275eeb1-62d8-4c16-9581-3129f0afe322', '0fa164d6-3300-4163-b31d-f2fa37599a75'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:14:14.888347 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:14.965151 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:15.073439 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:14:15.081480 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] Deleted volume successfully. Jul 30 21:14:15.104557 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-be759a1e-101c-48c3-a5ac-07dadcd98cc4 tempest-ServerRescueNegativeTestJSON-115835355 None] Lock "cinder-614115ca-d5a6-460a-a6c0-928cfeb56502-delete_volume" released by "delete_volume" :: held 0.909s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:14:15.940731 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:14:15.942208 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:15.995742 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:16.044624 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:14:17.728831 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:14:17.787951 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Flow 'volume_create_manager' (9c044db4-4b95-4e46-ae2b-63877b393141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:14:17.797996 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd8639b-67ce-41b1-a757-d037fe5d0435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:17.822751 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd8639b-67ce-41b1-a757-d037fe5d0435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1331090731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cdadebb0-ebcf-41e7-8deb-8aa3b8414655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bddb6ea5e6b470592072376351e7ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:14:18Z,use_quota=True,user_id='046af69274664f7abac7cd594988a66c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:17.831807 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be2f5ee-21e2-4354-bf49-160033f1b2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:17.838679 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be2f5ee-21e2-4354-bf49-160033f1b2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:17.846657 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddab0c9-84f5-4fa0-b8f7-7fcaea5f09e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:17.853775 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddab0c9-84f5-4fa0-b8f7-7fcaea5f09e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdadebb0-ebcf-41e7-8deb-8aa3b8414655', 'volume_name': 'volume-cdadebb0-ebcf-41e7-8deb-8aa3b8414655', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:17.867420 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51677614-f664-4f86-80e7-ea23a55d578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:17.876257 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51677614-f664-4f86-80e7-ea23a55d578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:17.884201 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022e1ffa-47a8-4372-a291-aa8cf21b175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:17.902013 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Volume cdadebb0-ebcf-41e7-8deb-8aa3b8414655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdadebb0-ebcf-41e7-8deb-8aa3b8414655', 'volume_size': 1} Jul 30 21:14:17.902776 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] creating volume 'volume-cdadebb0-ebcf-41e7-8deb-8aa3b8414655' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:14:17.904735 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:18.024549 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:14:18.025308 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:14:18.029911 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022e1ffa-47a8-4372-a291-aa8cf21b175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdadebb0-ebcf-41e7-8deb-8aa3b8414655', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:18.036434 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0300e84a-781a-40f4-9cbf-23acd3c5ef7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:14:18.057354 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Volume volume-cdadebb0-ebcf-41e7-8deb-8aa3b8414655 (cdadebb0-ebcf-41e7-8deb-8aa3b8414655): created successfully Jul 30 21:14:18.061216 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0300e84a-781a-40f4-9cbf-23acd3c5ef7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:14:18.068337 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Flow 'volume_create_manager' (9c044db4-4b95-4e46-ae2b-63877b393141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:14:18.090672 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-6c971ab9-58b9-43fe-a797-404a5397ebee req-2e04952b-7a30-474c-97f2-550c9cc7cce6 tempest-VolumesSnapshotsTestJSON-895483676 None] Created volume successfully. Jul 30 21:14:18.846857 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-4c7ba266-082b-4761-b40f-2253dc2ba0d6 req-703f8ec3-442d-4586-aaa5-988bd6e409fa tempest-VolumesSnapshotsTestJSON-895483676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:19.259805 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-4c7ba266-082b-4761-b40f-2253dc2ba0d6 req-703f8ec3-442d-4586-aaa5-988bd6e409fa tempest-VolumesSnapshotsTestJSON-895483676 None] Create snapshot completed successfully Jul 30 21:14:19.711742 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-3501cc71-de76-4bfd-adc4-33ff18191323 req-383dd9f1-1192-43e3-a78b-1b93a252155a tempest-VolumesSnapshotsTestJSON-895483676 None] Acquiring lock "cinder-c4f57fc6-14c3-4411-aa90-c8dada34727a-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:14:19.729769 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-3501cc71-de76-4bfd-adc4-33ff18191323 req-383dd9f1-1192-43e3-a78b-1b93a252155a tempest-VolumesSnapshotsTestJSON-895483676 None] Lock "cinder-c4f57fc6-14c3-4411-aa90-c8dada34727a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:14:19.734457 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-3501cc71-de76-4bfd-adc4-33ff18191323 req-383dd9f1-1192-43e3-a78b-1b93a252155a tempest-VolumesSnapshotsTestJSON-895483676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:20.331856 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [req-3501cc71-de76-4bfd-adc4-33ff18191323 req-383dd9f1-1192-43e3-a78b-1b93a252155a tempest-VolumesSnapshotsTestJSON-895483676 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:14:20.350031 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [req-3501cc71-de76-4bfd-adc4-33ff18191323 req-383dd9f1-1192-43e3-a78b-1b93a252155a tempest-VolumesSnapshotsTestJSON-895483676 None] Created reservations ['1f18b923-a168-428f-8bf1-2de6814a50a9', 'cd8624d1-ed00-40a0-8232-e0eb2dd4f3a2', 'e6fbd606-d27a-4a84-a448-998ec946adc1', 'c30046c6-87c5-48ea-99f4-55bfe8652071'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:14:20.456259 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-3501cc71-de76-4bfd-adc4-33ff18191323 req-383dd9f1-1192-43e3-a78b-1b93a252155a tempest-VolumesSnapshotsTestJSON-895483676 None] Delete snapshot completed successfully. Jul 30 21:14:20.469119 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-3501cc71-de76-4bfd-adc4-33ff18191323 req-383dd9f1-1192-43e3-a78b-1b93a252155a tempest-VolumesSnapshotsTestJSON-895483676 None] Lock "cinder-c4f57fc6-14c3-4411-aa90-c8dada34727a-delete_snapshot" released by "delete_snapshot" :: held 0.739s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:14:20.684767 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] Acquiring lock "cinder-cdadebb0-ebcf-41e7-8deb-8aa3b8414655-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:14:20.698612 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] Lock "cinder-cdadebb0-ebcf-41e7-8deb-8aa3b8414655-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:14:20.762149 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:20.883504 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:14:20.883934 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] Volume volume-cdadebb0-ebcf-41e7-8deb-8aa3b8414655 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:14:20.892358 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] deleting rbd volume volume-cdadebb0-ebcf-41e7-8deb-8aa3b8414655 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:14:21.392304 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] Created reservations ['b0cdafed-019e-44e4-911d-f22f6145adcf', '55b0efc8-c67c-46c5-b3e2-73e99a1a4e97', 'ae7c6fc5-1c88-4c15-8e64-c9075cf0a663', 'd1a8ffe4-7f6a-4337-bb91-33418410ecf9'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:14:21.408032 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=61,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=9 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:21.516179 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:21.568520 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:14:21.629833 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:14:21.635960 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] Deleted volume successfully. Jul 30 21:14:21.661268 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-10f9ca88-0922-4c9b-9e9d-96280a049f78 req-18dc5e21-0ca9-4369-80ba-be913bb34fc8 tempest-VolumesSnapshotsTestJSON-895483676 None] Lock "cinder-cdadebb0-ebcf-41e7-8deb-8aa3b8414655-delete_volume" released by "delete_volume" :: held 0.962s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:14:33.392125 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:33.397339 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:INSERT=7,cinder:UPDATE=36,cinder:SELECT=49,cinder:DELETE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:14:57.646069 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-b970f611-ce65-4f35-ace4-33b54dc3cee6 req-d2dd7180-be7f-4322-afbb-f4bc378a6c0e tempest-AttachVolumeShelveTestJSON-1107471233 None] No connector for attachment 0b8360a5-50ad-44a4-a7b0-dd86f6f74f81; skipping storage backend terminate_connection call. {{(pid=124008) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4953}} Jul 30 21:14:57.646780 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-b970f611-ce65-4f35-ace4-33b54dc3cee6 req-d2dd7180-be7f-4322-afbb-f4bc378a6c0e tempest-AttachVolumeShelveTestJSON-1107471233 None] Deleting attachment 0b8360a5-50ad-44a4-a7b0-dd86f6f74f81. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:15:13.331360 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:13.333016 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:15.937877 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:15:15.938705 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:15:15.996759 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:15:16.059374 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:15:16.171131 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] Acquiring lock "cinder-f81f5558-43b4-4c6a-a9ba-6e695e56d674-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:15:16.195555 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] Lock "cinder-f81f5558-43b4-4c6a-a9ba-6e695e56d674-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:15:16.261619 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:15:16.331578 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:15:16.332123 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] Volume volume-f81f5558-43b4-4c6a-a9ba-6e695e56d674 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:15:16.349447 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] deleting rbd volume volume-f81f5558-43b4-4c6a-a9ba-6e695e56d674 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:15:16.709133 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] Created reservations ['43993796-1f9e-4637-972e-dfe43adc02a0', '54151302-890a-40c3-ad4a-3c3deb8514f1', 'b913dbf4-4e0c-4456-a388-ae94af3b16b0', '5be57f64-ee21-458a-9f0a-c5cbb79506be'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:15:16.780014 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:15:16.823124 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:15:16.891050 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:15:16.895789 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] Deleted volume successfully. Jul 30 21:15:16.917386 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d2da0c99-eb1d-4f5c-af55-3969cf7165ca tempest-DeleteServersTestJSON-1715350511 None] Lock "cinder-f81f5558-43b4-4c6a-a9ba-6e695e56d674-delete_volume" released by "delete_volume" :: held 0.722s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:15:33.344207 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:15:53.354293 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=18,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:05.312241 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] Acquiring lock "cinder-e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:16:05.327545 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] Lock "cinder-e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:16:05.335683 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:05.372121 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:05.419117 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:16:05.422074 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] Volume volume-e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:16:05.432400 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] deleting rbd volume volume-e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:16:05.721932 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] Created reservations ['87eb98e6-054c-430f-9731-810559c36000', '5f657e41-27b2-418c-99fa-4a4688852b48', 'e552d259-a32a-455f-a568-854006b824b5', 'b688a699-b0a9-4a95-857f-f8e99cf85318'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:16:05.780967 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:05.826277 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:05.860718 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:16:05.868767 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] Deleted volume successfully. Jul 30 21:16:05.882460 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bc0b80dc-8480-4981-b32a-2098c2270ee4 tempest-AttachVolumeShelveTestJSON-1107471233 None] Lock "cinder-e2906a4f-cf87-4ac0-a1c1-ff2d144d6bac-delete_volume" released by "delete_volume" :: held 0.555s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:16:06.752132 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] Acquiring lock "cinder-d22ff22c-052a-42ef-9649-a89754fa834d-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:16:06.777048 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] Lock "cinder-d22ff22c-052a-42ef-9649-a89754fa834d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:16:06.840178 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:06.967708 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:16:06.968302 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] Volume volume-d22ff22c-052a-42ef-9649-a89754fa834d is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:16:06.989179 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] deleting rbd volume volume-d22ff22c-052a-42ef-9649-a89754fa834d {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:16:07.416946 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] Created reservations ['5dc03c42-d22a-4de0-820c-8ad178ebdb43', '00abcb04-6767-4067-98d5-c504ebc60a76', '4bc2539d-2ed7-439b-ab2a-28cca9bbee82', 'd26b5658-178d-43c7-8f64-f8a186ba709a'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:16:07.488610 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:07.549935 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:07.608634 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:16:07.614606 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] Deleted volume successfully. Jul 30 21:16:07.639901 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8498acf4-6deb-496d-918c-e158967af4c9 tempest-AttachVolumeShelveTestJSON-1107471233 None] Lock "cinder-d22ff22c-052a-42ef-9649-a89754fa834d-delete_volume" released by "delete_volume" :: held 0.864s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:16:15.939521 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:16:15.940275 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:16.007567 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:16.055197 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:16:23.344210 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:39.490032 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=33,cinder:INSERT=4,cinder:UPDATE=19 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:16:39.523645 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:16:39.575062 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Flow 'volume_create_manager' (031af953-5a35-4e33-8aee-4b7957904ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:16:39.595153 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99aa4143-6d97-4152-9ffa-7c03433c3dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:39.652191 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99aa4143-6d97-4152-9ffa-7c03433c3dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1445210363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=db10433c-ccc0-4fb5-b776-13e3bc933f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73245fdcb10c4144a60fa8ca6b6a7ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:16:39Z,use_quota=True,user_id='23ba5ddf22424eff840602440872f86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:39.659803 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbead52-c4e0-4a78-96df-9f71af219a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:39.674968 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbead52-c4e0-4a78-96df-9f71af219a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:39.686655 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e0901c-d8a3-4ae4-941e-bee4bacbebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:39.690617 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e0901c-d8a3-4ae4-941e-bee4bacbebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db10433c-ccc0-4fb5-b776-13e3bc933f4f', 'volume_name': 'volume-db10433c-ccc0-4fb5-b776-13e3bc933f4f', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:39.702079 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e43b75-a781-438e-b498-7b5b0980dfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:39.708176 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e43b75-a781-438e-b498-7b5b0980dfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:39.720186 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546db0ec-1c4f-41f0-988a-70c2851e2ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:39.720683 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Volume db10433c-ccc0-4fb5-b776-13e3bc933f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db10433c-ccc0-4fb5-b776-13e3bc933f4f', 'volume_size': 1} Jul 30 21:16:39.722320 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] creating volume 'volume-db10433c-ccc0-4fb5-b776-13e3bc933f4f' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:16:39.723436 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:39.848139 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:16:39.849100 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:16:39.867357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546db0ec-1c4f-41f0-988a-70c2851e2ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db10433c-ccc0-4fb5-b776-13e3bc933f4f', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:39.876241 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187d4f8a-6819-4a90-9c5a-9c564a825fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:39.893849 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Volume volume-db10433c-ccc0-4fb5-b776-13e3bc933f4f (db10433c-ccc0-4fb5-b776-13e3bc933f4f): created successfully Jul 30 21:16:39.901951 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187d4f8a-6819-4a90-9c5a-9c564a825fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:39.912665 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Flow 'volume_create_manager' (031af953-5a35-4e33-8aee-4b7957904ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:16:39.925202 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-7b2e72bb-34e7-4d46-8457-d07585db8f24 tempest-ServersNegativeTestJSON-1663379598 None] Created volume successfully. Jul 30 21:16:45.752114 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:16:45.798625 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Flow 'volume_create_manager' (0927ccbd-5340-4583-b9de-17bbaa9ea19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:16:45.807641 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc25d06a-e83d-4c5b-872d-1560dafb6711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:45.834979 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc25d06a-e83d-4c5b-872d-1560dafb6711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-81996655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=48078879-4d0f-4421-a875-29cf671cc11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73245fdcb10c4144a60fa8ca6b6a7ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:16:46Z,use_quota=True,user_id='23ba5ddf22424eff840602440872f86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:45.845680 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab57bd8-0f76-4ba2-a30e-0f0c5051e6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:45.855961 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab57bd8-0f76-4ba2-a30e-0f0c5051e6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:45.862710 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5488d8-9b7b-43c9-b04a-4e8e0b7c6a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:45.870954 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5488d8-9b7b-43c9-b04a-4e8e0b7c6a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48078879-4d0f-4421-a875-29cf671cc11a', 'volume_name': 'volume-48078879-4d0f-4421-a875-29cf671cc11a', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:45.876818 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71a9a22-28e4-4f30-a713-5e60ba6be88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:45.881877 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71a9a22-28e4-4f30-a713-5e60ba6be88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:45.899088 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68810867-2507-4fc0-8431-dd2ece040008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:45.903115 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Volume 48078879-4d0f-4421-a875-29cf671cc11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48078879-4d0f-4421-a875-29cf671cc11a', 'volume_size': 1} Jul 30 21:16:45.903753 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] creating volume 'volume-48078879-4d0f-4421-a875-29cf671cc11a' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:16:45.904569 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:46.082376 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:16:46.082983 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:16:46.087366 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68810867-2507-4fc0-8431-dd2ece040008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48078879-4d0f-4421-a875-29cf671cc11a', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:46.092695 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e98d1b36-5a54-436b-9ae1-bfa820f98ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:46.158381 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Volume volume-48078879-4d0f-4421-a875-29cf671cc11a (48078879-4d0f-4421-a875-29cf671cc11a): created successfully Jul 30 21:16:46.168421 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e98d1b36-5a54-436b-9ae1-bfa820f98ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:46.195539 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Flow 'volume_create_manager' (0927ccbd-5340-4583-b9de-17bbaa9ea19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:16:46.220295 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0afaee02-6431-4e6d-8b6b-46b1fe5c4c0e tempest-ServersNegativeTestJSON-1663379598 None] Created volume successfully. Jul 30 21:16:57.211210 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:16:57.256868 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Flow 'volume_create_manager' (9c806f46-aff4-4e84-b5b9-8fac894a8941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:16:57.291909 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f690213-4528-4806-b307-22e03b2c3ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:57.326671 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f690213-4528-4806-b307-22e03b2c3ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1006172281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1a378643-26a9-4022-b012-defa76e4082f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8696e08b027f4d259759dff57403f900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:16:57Z,use_quota=True,user_id='7369e2a4c5b24e85b94816e6404b300f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:57.340943 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4319f0-4f32-4998-a581-f60a9805baab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:57.347217 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4319f0-4f32-4998-a581-f60a9805baab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:57.362784 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e586ebad-5a39-4bc3-a727-8aa2df8fc265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:57.518920 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e586ebad-5a39-4bc3-a727-8aa2df8fc265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a378643-26a9-4022-b012-defa76e4082f', 'volume_name': 'volume-1a378643-26a9-4022-b012-defa76e4082f', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:57.526726 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e5169a-1251-47ab-9980-55cc3b9567dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:57.533084 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e5169a-1251-47ab-9980-55cc3b9567dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:57.540665 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c86225b-1f08-43e8-a547-d3203b3943c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:57.543392 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume 1a378643-26a9-4022-b012-defa76e4082f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a378643-26a9-4022-b012-defa76e4082f', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:16:57.544251 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Cloning 1a378643-26a9-4022-b012-defa76e4082f from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:16:57.545428 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:16:57.570011 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:16:57.606256 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 16, 57, 592343)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:16:57.607483 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:16:57.607961 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:16:57.617737 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.046s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:16:57.619898 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:16:57.630247 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 16, 57, 626489)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:16:57.631059 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:16:57.635959 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:16:57.670864 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:16:57.803344 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] creating snapshot='volume-1a378643-26a9-4022-b012-defa76e4082f.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:16:58.802007 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-1a378643-26a9-4022-b012-defa76e4082f.clone_snap' to 'volume-1a378643-26a9-4022-b012-defa76e4082f' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:16:59.081165 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:16:59.082478 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:16:59.083019 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:16:59.120210 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:16:59.123214 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Marking volume 1a378643-26a9-4022-b012-defa76e4082f as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:16:59.138563 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to 1a378643-26a9-4022-b012-defa76e4082f. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:16:59.139248 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Creating volume glance metadata for volume 1a378643-26a9-4022-b012-defa76e4082f backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:16:59.269736 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c86225b-1f08-43e8-a547-d3203b3943c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a378643-26a9-4022-b012-defa76e4082f', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:59.276936 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ca4c00-9d49-46b7-9700-ff0ce1adc385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:16:59.303855 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume volume-1a378643-26a9-4022-b012-defa76e4082f (1a378643-26a9-4022-b012-defa76e4082f): created successfully Jul 30 21:16:59.308434 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ca4c00-9d49-46b7-9700-ff0ce1adc385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:16:59.319176 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Flow 'volume_create_manager' (9c806f46-aff4-4e84-b5b9-8fac894a8941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:16:59.341559 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8220aacc-b9d7-43fd-bdc6-7d1baa58977e tempest-TaggedBootDevicesTest_v242-1264652532 None] Created volume successfully. Jul 30 21:17:01.317211 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:17:01.368444 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Flow 'volume_create_manager' (124fab64-05a3-4ddc-83b4-f1e528ba1f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:17:01.376406 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eacd9c5-a6b1-497f-bdc4-67c753850e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:01.406883 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eacd9c5-a6b1-497f-bdc4-67c753850e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1088677893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e3e52bb-c8b5-4e24-ada0-08f0ff72f891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8696e08b027f4d259759dff57403f900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:17:01Z,use_quota=True,user_id='7369e2a4c5b24e85b94816e6404b300f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:01.414291 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a68ce07-d1ef-4278-a842-a4d7c10cdba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:01.430220 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a68ce07-d1ef-4278-a842-a4d7c10cdba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:01.438175 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda1a9d5-2478-4f41-b404-dd478d8d2f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:01.449313 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda1a9d5-2478-4f41-b404-dd478d8d2f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e3e52bb-c8b5-4e24-ada0-08f0ff72f891', 'volume_name': 'volume-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:01.472693 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b1b632-8d11-4887-bd6a-3c17261431be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:01.494748 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b1b632-8d11-4887-bd6a-3c17261431be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:01.505381 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ab8125-9301-485d-87a5-a8f6baad7744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:01.506639 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume 0e3e52bb-c8b5-4e24-ada0-08f0ff72f891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891', 'volume_size': 1} Jul 30 21:17:01.507319 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] creating volume 'volume-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:17:01.508116 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:01.669396 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:17:01.669833 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:17:01.678302 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ab8125-9301-485d-87a5-a8f6baad7744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:01.689762 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0357ca6-7984-47d0-8709-860be7702105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:01.717882 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume volume-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891 (0e3e52bb-c8b5-4e24-ada0-08f0ff72f891): created successfully Jul 30 21:17:01.726030 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0357ca6-7984-47d0-8709-860be7702105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:01.741865 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Flow 'volume_create_manager' (124fab64-05a3-4ddc-83b4-f1e528ba1f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:17:01.763841 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8ddae79a-b200-4ebf-bf36-436b376077fc tempest-TaggedBootDevicesTest_v242-1264652532 None] Created volume successfully. Jul 30 21:17:02.783496 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:17:02.816745 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Flow 'volume_create_manager' (e408c58c-611d-4d4c-8f96-50c8c8d1e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:17:02.832252 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afff443-d731-4df1-b880-69919fb830f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:02.860561 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afff443-d731-4df1-b880-69919fb830f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-300325283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=35b2a01c-5c18-4761-974d-a4089f62e4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8696e08b027f4d259759dff57403f900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:17:03Z,use_quota=True,user_id='7369e2a4c5b24e85b94816e6404b300f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:02.866323 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f1a975-0bf2-48ab-b969-c2888ffc7689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:02.871561 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f1a975-0bf2-48ab-b969-c2888ffc7689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:02.877182 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befdca6d-a2e1-4094-acd8-598f08d62663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:02.883368 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befdca6d-a2e1-4094-acd8-598f08d62663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b2a01c-5c18-4761-974d-a4089f62e4a3', 'volume_name': 'volume-35b2a01c-5c18-4761-974d-a4089f62e4a3', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:02.888326 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9623e037-2fed-4fc9-81d7-951ffadbcafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:02.894159 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9623e037-2fed-4fc9-81d7-951ffadbcafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:02.899195 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6e157e-a1cc-438c-8903-d1d5789fd430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:02.900860 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume 35b2a01c-5c18-4761-974d-a4089f62e4a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b2a01c-5c18-4761-974d-a4089f62e4a3', 'volume_size': 1} Jul 30 21:17:02.901494 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] creating volume 'volume-35b2a01c-5c18-4761-974d-a4089f62e4a3' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:17:02.902281 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:03.008864 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:17:03.009397 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:17:03.013378 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6e157e-a1cc-438c-8903-d1d5789fd430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b2a01c-5c18-4761-974d-a4089f62e4a3', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:03.022673 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c015686-288f-4baf-9aa3-972c5824fbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:03.033918 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume volume-35b2a01c-5c18-4761-974d-a4089f62e4a3 (35b2a01c-5c18-4761-974d-a4089f62e4a3): created successfully Jul 30 21:17:03.039358 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c015686-288f-4baf-9aa3-972c5824fbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:03.046105 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Flow 'volume_create_manager' (e408c58c-611d-4d4c-8f96-50c8c8d1e59e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:17:03.062269 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b7d938d4-4aa9-4b76-bdd8-cf8f7c2734b8 tempest-TaggedBootDevicesTest_v242-1264652532 None] Created volume successfully. Jul 30 21:17:13.355521 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=36,cinder:UPDATE=9,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:13.357001 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=36,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=12 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:15.941917 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:17:15.942715 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:16.047630 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:16.130531 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:17:21.791610 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:17:21.878699 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Flow 'volume_create_manager' (b7168cbf-e3ba-4625-b483-d7c4d8686655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:17:21.901585 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50606758-7c83-47dd-a25c-4f28e7441b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:21.943107 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50606758-7c83-47dd-a25c-4f28e7441b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2112549053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b17ea6d6-e43a-4bc8-927f-4c1761e8effa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337bb83600d7464bad03a15d3bbe7d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:17:22Z,use_quota=True,user_id='20bea5c4d7ee4dec90aeda50c35f68e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:21.957004 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e830df-74d9-4b07-a8d8-2c9e35b60156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:21.963486 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e830df-74d9-4b07-a8d8-2c9e35b60156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:21.972990 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88de779-c6aa-46fa-8214-bcd4a7d3a051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:21.980530 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88de779-c6aa-46fa-8214-bcd4a7d3a051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17ea6d6-e43a-4bc8-927f-4c1761e8effa', 'volume_name': 'volume-b17ea6d6-e43a-4bc8-927f-4c1761e8effa', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:21.987389 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff88cca8-59da-470f-a20a-836b8bbf5b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:22.017419 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff88cca8-59da-470f-a20a-836b8bbf5b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:22.031146 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0dff59f-bd76-4305-9583-c1ee056482f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:22.032498 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Volume b17ea6d6-e43a-4bc8-927f-4c1761e8effa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17ea6d6-e43a-4bc8-927f-4c1761e8effa', 'volume_size': 1} Jul 30 21:17:22.033457 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] creating volume 'volume-b17ea6d6-e43a-4bc8-927f-4c1761e8effa' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:17:22.034402 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:22.194634 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:17:22.195438 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:17:22.208675 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0dff59f-bd76-4305-9583-c1ee056482f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17ea6d6-e43a-4bc8-927f-4c1761e8effa', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:22.221126 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b0dcd4-a7e9-4173-879b-3a4b0a47cb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:22.256115 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Volume volume-b17ea6d6-e43a-4bc8-927f-4c1761e8effa (b17ea6d6-e43a-4bc8-927f-4c1761e8effa): created successfully Jul 30 21:17:22.266466 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b0dcd4-a7e9-4173-879b-3a4b0a47cb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:22.287658 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Flow 'volume_create_manager' (b7168cbf-e3ba-4625-b483-d7c4d8686655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:17:22.311359 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bd8e4855-158c-4a9b-a22a-246e5fbe8f8c tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Created volume successfully. Jul 30 21:17:24.422357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Acquiring lock "cinder-b17ea6d6-e43a-4bc8-927f-4c1761e8effa-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:17:24.436570 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Lock "cinder-b17ea6d6-e43a-4bc8-927f-4c1761e8effa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:17:24.499820 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:24.575235 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:17:24.576331 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Volume volume-b17ea6d6-e43a-4bc8-927f-4c1761e8effa is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:17:24.583788 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] deleting rbd volume volume-b17ea6d6-e43a-4bc8-927f-4c1761e8effa {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:17:24.911205 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Created reservations ['ca1c5017-9f31-4d85-80ff-57117b24cf4b', '7e4b9744-d604-4b07-874b-8b1e6409f482', 'd14fd172-7e41-49d8-8d45-1ff9e722cc0c', '5a63bd85-35d0-4f00-8a41-d8d6995dca20'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:17:24.973460 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:25.031051 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:25.087897 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:17:25.099198 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Deleted volume successfully. Jul 30 21:17:25.125054 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0a858768-7dce-4680-8f2d-46814b5ff412 tempest-VolumeQuotasNegativeTestJSON-1989611498 None] Lock "cinder-b17ea6d6-e43a-4bc8-927f-4c1761e8effa-delete_volume" released by "delete_volume" :: held 0.688s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:17:28.656096 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-46c77830-6f28-4f67-9067-0a2dcad21679 tempest-TaggedBootDevicesTest_v242-1264652532 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:17:29.937907 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-46c77830-6f28-4f67-9067-0a2dcad21679 tempest-TaggedBootDevicesTest_v242-1264652532 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.282s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:17:29.938685 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-46c77830-6f28-4f67-9067-0a2dcad21679 tempest-TaggedBootDevicesTest_v242-1264652532 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1a378643-26a9-4022-b012-defa76e4082f', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '1a378643-26a9-4022-b012-defa76e4082f', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:17:30.000274 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-46c77830-6f28-4f67-9067-0a2dcad21679 tempest-TaggedBootDevicesTest_v242-1264652532 None] Connection info returned from driver {'name': 'volumes/volume-1a378643-26a9-4022-b012-defa76e4082f', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1a378643-26a9-4022-b012-defa76e4082f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b9312807-38e9-497d-ab5c-a2678b1ca024'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:17:30.159764 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-46c77830-6f28-4f67-9067-0a2dcad21679 tempest-TaggedBootDevicesTest_v242-1264652532 None] attachment_update completed successfully. Jul 30 21:17:30.839614 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-05c7a96b-3246-43c9-8f0a-ef7cac4f1fc6 tempest-TaggedBootDevicesTest_v242-1264652532 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:17:33.098594 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-05c7a96b-3246-43c9-8f0a-ef7cac4f1fc6 tempest-TaggedBootDevicesTest_v242-1264652532 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.259s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:17:33.100135 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-05c7a96b-3246-43c9-8f0a-ef7cac4f1fc6 tempest-TaggedBootDevicesTest_v242-1264652532 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '0e3e52bb-c8b5-4e24-ada0-08f0ff72f891', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:17:33.221323 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-05c7a96b-3246-43c9-8f0a-ef7cac4f1fc6 tempest-TaggedBootDevicesTest_v242-1264652532 None] Connection info returned from driver {'name': 'volumes/volume-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0e3e52bb-c8b5-4e24-ada0-08f0ff72f891', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'faf38dc3-5305-418e-b43b-0e1c120356cd'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:17:33.373214 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-05c7a96b-3246-43c9-8f0a-ef7cac4f1fc6 tempest-TaggedBootDevicesTest_v242-1264652532 None] attachment_update completed successfully. Jul 30 21:17:34.034632 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-8f20d6db-6c44-4888-b3de-1b165830ef14 tempest-TaggedBootDevicesTest_v242-1264652532 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:17:34.979428 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:17:35.094654 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Flow 'volume_create_manager' (6f410aa1-73f7-4509-bf79-882964f45d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:17:35.102754 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17956300-0fea-4435-966f-4506cbfb2b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:35.137326 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17956300-0fea-4435-966f-4506cbfb2b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1424934625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fb88b9b0-e86f-4861-b48f-4b000a289f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c817036e10a44bfa71d235dd8a3b0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:17:35Z,use_quota=True,user_id='f879fe7d81cd467ea6dba3e2b483a5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:35.146504 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286c4151-99ef-4388-b882-35c73e6dff3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:35.153526 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286c4151-99ef-4388-b882-35c73e6dff3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:35.162450 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9d5681-ca1f-4243-bc80-195b2c671d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:35.168538 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9d5681-ca1f-4243-bc80-195b2c671d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb88b9b0-e86f-4861-b48f-4b000a289f8f', 'volume_name': 'volume-fb88b9b0-e86f-4861-b48f-4b000a289f8f', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:35.177206 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829e4985-13e6-43f0-b1b1-bfb8f28f04f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:35.183260 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829e4985-13e6-43f0-b1b1-bfb8f28f04f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:35.191045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6696cf56-afae-4da0-924f-53b1f942b1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:35.193441 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Volume fb88b9b0-e86f-4861-b48f-4b000a289f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb88b9b0-e86f-4861-b48f-4b000a289f8f', 'volume_size': 1} Jul 30 21:17:35.194088 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] creating volume 'volume-fb88b9b0-e86f-4861-b48f-4b000a289f8f' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:17:35.195520 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:35.323696 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:17:35.324319 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:17:35.329452 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6696cf56-afae-4da0-924f-53b1f942b1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb88b9b0-e86f-4861-b48f-4b000a289f8f', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:35.341695 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f9859b-4f13-4f53-a49b-7ba6a61bbaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:35.365908 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Volume volume-fb88b9b0-e86f-4861-b48f-4b000a289f8f (fb88b9b0-e86f-4861-b48f-4b000a289f8f): created successfully Jul 30 21:17:35.377664 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f9859b-4f13-4f53-a49b-7ba6a61bbaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:35.392722 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Flow 'volume_create_manager' (6f410aa1-73f7-4509-bf79-882964f45d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:17:35.410926 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-86ac7f67-8548-44b4-9c3f-9e659aadee99 tempest-VolumesServicesTestJSON-897990652 None] Created volume successfully. Jul 30 21:17:35.642891 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-8f20d6db-6c44-4888-b3de-1b165830ef14 tempest-TaggedBootDevicesTest_v242-1264652532 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.610s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:17:35.643956 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-8f20d6db-6c44-4888-b3de-1b165830ef14 tempest-TaggedBootDevicesTest_v242-1264652532 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-35b2a01c-5c18-4761-974d-a4089f62e4a3', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '35b2a01c-5c18-4761-974d-a4089f62e4a3', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:17:35.675898 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-8f20d6db-6c44-4888-b3de-1b165830ef14 tempest-TaggedBootDevicesTest_v242-1264652532 None] Connection info returned from driver {'name': 'volumes/volume-35b2a01c-5c18-4761-974d-a4089f62e4a3', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '35b2a01c-5c18-4761-974d-a4089f62e4a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0a06feb5-645c-4d3d-b0ea-3a1bdde8b504'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:17:35.783189 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-d89595c3-9dad-4cb1-ac4c-bef1eb05b40b req-8f20d6db-6c44-4888-b3de-1b165830ef14 tempest-TaggedBootDevicesTest_v242-1264652532 None] attachment_update completed successfully. Jul 30 21:17:36.251801 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] Acquiring lock "cinder-fb88b9b0-e86f-4861-b48f-4b000a289f8f-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:17:36.281069 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] Lock "cinder-fb88b9b0-e86f-4861-b48f-4b000a289f8f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:17:36.366795 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:36.474826 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:17:36.475665 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] Volume volume-fb88b9b0-e86f-4861-b48f-4b000a289f8f is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:17:36.488842 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] deleting rbd volume volume-fb88b9b0-e86f-4861-b48f-4b000a289f8f {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:17:36.899547 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] Created reservations ['4f1bdfef-ba56-4b04-8a8d-5e71dd6eb23e', '1b7b1f6a-4f6d-4da5-a2f8-844f79ea49ac', 'cc7531ea-bbfb-4811-8cd3-474c93d2f122', 'b211ccac-729b-4682-b1d1-e6d433a1fc1b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:17:37.077113 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:37.175890 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:37.276673 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:17:37.294351 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] Deleted volume successfully. Jul 30 21:17:37.329259 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3feeeb77-93c4-4107-822e-760b0cf047ad tempest-VolumesServicesTestJSON-897990652 None] Lock "cinder-fb88b9b0-e86f-4861-b48f-4b000a289f8f-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:17:43.362219 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=71,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:43.381953 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=66,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:17:52.149305 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:17:52.181084 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Flow 'volume_create_manager' (7a2f5a48-9cd2-4feb-a865-c64cb84963fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:17:52.193409 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf18d61-7e22-4ec5-b11d-ebe53866a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:52.215780 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf18d61-7e22-4ec5-b11d-ebe53866a61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1020583186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4466b368-2df0-451f-b9de-bcfbc8deb4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad18d4d568444acfa7bf7410eaa3f633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:17:52Z,use_quota=True,user_id='bc7af1a887eb4a19b89465e67ae0833c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:52.221912 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365eaa79-cf5a-43fc-b7a6-e75f3e4f4872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:52.227107 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365eaa79-cf5a-43fc-b7a6-e75f3e4f4872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:52.233141 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc5f507-980a-4c0d-a244-6f576dfabe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:52.237993 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc5f507-980a-4c0d-a244-6f576dfabe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4466b368-2df0-451f-b9de-bcfbc8deb4d3', 'volume_name': 'volume-4466b368-2df0-451f-b9de-bcfbc8deb4d3', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:52.244405 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267e5741-ef01-4bf1-9f4f-4a10a3f8645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:52.248599 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267e5741-ef01-4bf1-9f4f-4a10a3f8645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:52.254466 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abbbd1d-47b9-4e7b-a30d-73619a4de2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:52.255742 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Volume 4466b368-2df0-451f-b9de-bcfbc8deb4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4466b368-2df0-451f-b9de-bcfbc8deb4d3', 'volume_size': 1} Jul 30 21:17:52.256308 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] creating volume 'volume-4466b368-2df0-451f-b9de-bcfbc8deb4d3' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:17:52.257222 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:52.357659 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:17:52.358395 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:17:52.363831 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abbbd1d-47b9-4e7b-a30d-73619a4de2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4466b368-2df0-451f-b9de-bcfbc8deb4d3', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:52.369001 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfb7914-d379-4274-bafe-7ecc124dc328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:17:52.380800 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Volume volume-4466b368-2df0-451f-b9de-bcfbc8deb4d3 (4466b368-2df0-451f-b9de-bcfbc8deb4d3): created successfully Jul 30 21:17:52.385372 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfb7914-d379-4274-bafe-7ecc124dc328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:17:52.395840 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Flow 'volume_create_manager' (7a2f5a48-9cd2-4feb-a865-c64cb84963fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:17:52.410543 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-aff25c73-b605-4e1a-9bf6-7cf965483487 tempest-VolumesSnapshotListTestJSON-581838813 None] Created volume successfully. Jul 30 21:17:53.424112 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9b76637-136b-4abc-89f3-f0e791d6e21f tempest-VolumesSnapshotListTestJSON-581838813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:54.122387 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b9b76637-136b-4abc-89f3-f0e791d6e21f tempest-VolumesSnapshotListTestJSON-581838813 None] Create snapshot completed successfully Jul 30 21:17:54.778818 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6e90c8fc-cd55-4877-ae60-c491ebd16201 tempest-VolumesSnapshotListTestJSON-581838813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:55.182547 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-6e90c8fc-cd55-4877-ae60-c491ebd16201 tempest-VolumesSnapshotListTestJSON-581838813 None] Create snapshot completed successfully Jul 30 21:17:56.291799 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-527a92ef-f8de-4334-bf06-e5d91eb3a5b5 tempest-VolumesSnapshotListTestJSON-581838813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:17:57.228010 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-527a92ef-f8de-4334-bf06-e5d91eb3a5b5 tempest-VolumesSnapshotListTestJSON-581838813 None] Create snapshot completed successfully Jul 30 21:17:59.403319 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b2c7ca60-ef43-4521-9921-3b812ee1d39c tempest-VolumesSnapshotListTestJSON-581838813 None] Acquiring lock "cinder-5f083c0e-ffb1-4426-a592-d768521fdbfb-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:17:59.422551 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b2c7ca60-ef43-4521-9921-3b812ee1d39c tempest-VolumesSnapshotListTestJSON-581838813 None] Lock "cinder-5f083c0e-ffb1-4426-a592-d768521fdbfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:17:59.424619 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b2c7ca60-ef43-4521-9921-3b812ee1d39c tempest-VolumesSnapshotListTestJSON-581838813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:18:00.303392 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-b2c7ca60-ef43-4521-9921-3b812ee1d39c tempest-VolumesSnapshotListTestJSON-581838813 None] Created reservations ['adfdb0ee-5124-4284-a6a1-0ae69b1e0b46', '21c879f0-4f60-4466-8458-865692f17541', '13a928dc-ba6b-4e46-92b6-ea0b2a1aabf8', 'deb9a647-9175-456f-8c79-30b1acdde975'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:18:00.357876 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b2c7ca60-ef43-4521-9921-3b812ee1d39c tempest-VolumesSnapshotListTestJSON-581838813 None] Delete snapshot completed successfully. Jul 30 21:18:00.362863 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b2c7ca60-ef43-4521-9921-3b812ee1d39c tempest-VolumesSnapshotListTestJSON-581838813 None] Lock "cinder-5f083c0e-ffb1-4426-a592-d768521fdbfb-delete_snapshot" released by "delete_snapshot" :: held 0.940s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:18:00.537066 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6ee893d9-de27-427b-93ec-8801a3aab375 tempest-VolumesSnapshotListTestJSON-581838813 None] Acquiring lock "cinder-862505a5-6702-444d-8496-54da06aaf6aa-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:18:00.547594 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6ee893d9-de27-427b-93ec-8801a3aab375 tempest-VolumesSnapshotListTestJSON-581838813 None] Lock "cinder-862505a5-6702-444d-8496-54da06aaf6aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:18:00.549705 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6ee893d9-de27-427b-93ec-8801a3aab375 tempest-VolumesSnapshotListTestJSON-581838813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:18:01.324609 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-6ee893d9-de27-427b-93ec-8801a3aab375 tempest-VolumesSnapshotListTestJSON-581838813 None] Created reservations ['fef00c06-2659-4173-950e-5687313e1117', '3e8deb14-9eb6-45e0-b90f-0ea6aef223e4', 'b6389791-f9b2-4412-80f3-89456cc6a4dd', '0a45946e-f64f-41f8-9657-7671150776e3'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:18:01.419610 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-6ee893d9-de27-427b-93ec-8801a3aab375 tempest-VolumesSnapshotListTestJSON-581838813 None] Delete snapshot completed successfully. Jul 30 21:18:01.425962 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6ee893d9-de27-427b-93ec-8801a3aab375 tempest-VolumesSnapshotListTestJSON-581838813 None] Lock "cinder-862505a5-6702-444d-8496-54da06aaf6aa-delete_snapshot" released by "delete_snapshot" :: held 0.878s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:18:01.684996 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-2da8873b-12ab-4b0c-98cc-b02da5760bc3 tempest-VolumesSnapshotListTestJSON-581838813 None] Acquiring lock "cinder-620a8066-7f5e-4cf9-8409-14341aa077a3-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:18:01.702601 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-2da8873b-12ab-4b0c-98cc-b02da5760bc3 tempest-VolumesSnapshotListTestJSON-581838813 None] Lock "cinder-620a8066-7f5e-4cf9-8409-14341aa077a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:18:01.704474 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2da8873b-12ab-4b0c-98cc-b02da5760bc3 tempest-VolumesSnapshotListTestJSON-581838813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:18:02.440508 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-2da8873b-12ab-4b0c-98cc-b02da5760bc3 tempest-VolumesSnapshotListTestJSON-581838813 None] Created reservations ['caa3205a-6698-40a0-a142-5c7f7d184059', '8b24391f-0341-472e-bcf7-749e3567d230', '849d0b29-20e5-4348-ba91-61df0f4d8bad', 'a860a0f4-cbcf-4482-8e6e-79cb741331ac'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:18:02.505740 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2da8873b-12ab-4b0c-98cc-b02da5760bc3 tempest-VolumesSnapshotListTestJSON-581838813 None] Delete snapshot completed successfully. Jul 30 21:18:02.513357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-2da8873b-12ab-4b0c-98cc-b02da5760bc3 tempest-VolumesSnapshotListTestJSON-581838813 None] Lock "cinder-620a8066-7f5e-4cf9-8409-14341aa077a3-delete_snapshot" released by "delete_snapshot" :: held 0.811s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:18:02.899709 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] Acquiring lock "cinder-4466b368-2df0-451f-b9de-bcfbc8deb4d3-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:18:02.912687 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] Lock "cinder-4466b368-2df0-451f-b9de-bcfbc8deb4d3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:18:02.990762 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:18:03.084086 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:18:03.096330 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] Volume volume-4466b368-2df0-451f-b9de-bcfbc8deb4d3 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:18:03.118838 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] deleting rbd volume volume-4466b368-2df0-451f-b9de-bcfbc8deb4d3 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:18:03.556596 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] Created reservations ['57fd458c-b210-41e8-aa18-ce0fb1932ed1', '8f171898-7d3c-44c3-aacc-c5bedc9fa94b', '64331a04-0937-4b1d-8f5a-d960419cadbe', '85448888-7bf1-493e-96da-b0594aa7fa85'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:18:03.656515 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=59,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=7 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:03.667000 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:18:03.775787 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:18:03.827722 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:18:03.832305 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] Deleted volume successfully. Jul 30 21:18:03.838495 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=60,cinder:UPDATE=30,cinder:INSERT=9,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:03.852721 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-336e4292-c298-4788-8ef5-99532a06119e tempest-VolumesSnapshotListTestJSON-581838813 None] Lock "cinder-4466b368-2df0-451f-b9de-bcfbc8deb4d3-delete_volume" released by "delete_volume" :: held 0.942s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:18:15.947358 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:18:15.948034 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:18:16.017356 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:18:16.135836 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:18:23.361707 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:43.358265 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:43.372391 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:18:46.757628 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-c8ebee52-a005-4b41-9332-c91e8a1a858c req-103bf7ae-4262-40d7-a0db-d17963e152a1 tempest-TaggedBootDevicesTest-1391871096 None] Terminate volume connection completed successfully. Jul 30 21:18:46.758189 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-c8ebee52-a005-4b41-9332-c91e8a1a858c req-103bf7ae-4262-40d7-a0db-d17963e152a1 tempest-TaggedBootDevicesTest-1391871096 None] Deleting attachment 694fcda7-ff5d-4e85-b359-4e0daf629eff. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:18:47.088867 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-c8ebee52-a005-4b41-9332-c91e8a1a858c req-6c6e56d8-68ea-4ae9-81c8-ddd81a9b0e5f tempest-TaggedBootDevicesTest-1391871096 None] Terminate volume connection completed successfully. Jul 30 21:18:47.091768 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-c8ebee52-a005-4b41-9332-c91e8a1a858c req-6c6e56d8-68ea-4ae9-81c8-ddd81a9b0e5f tempest-TaggedBootDevicesTest-1391871096 None] Deleting attachment f8d136a0-1ef7-422f-b75a-e692e259cb42. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:18:47.281556 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-c8ebee52-a005-4b41-9332-c91e8a1a858c req-f96d64e6-0762-4d60-9a97-483c31880cdf tempest-TaggedBootDevicesTest-1391871096 None] Terminate volume connection completed successfully. Jul 30 21:18:47.297274 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-c8ebee52-a005-4b41-9332-c91e8a1a858c req-f96d64e6-0762-4d60-9a97-483c31880cdf tempest-TaggedBootDevicesTest-1391871096 None] Deleting attachment d1a775f2-dd00-4d45-a280-8c1419ce7bdf. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:18:57.429045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:18:57.473716 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Flow 'volume_create_manager' (b99591ae-f97d-4573-842d-1473a8cca67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:18:57.491029 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dd78bf-bce0-4201-acad-da315134d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:18:57.534087 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dd78bf-bce0-4201-acad-da315134d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1810068561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6f46a667-d127-4702-8aba-e71d9caa3adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd884e1c0861450e9049a966a5931675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:18:57Z,use_quota=True,user_id='f4b80fe0ec404f0480948be6e051c9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:18:57.550270 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd26b8a-d1a2-4e02-9e80-683740131aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:18:57.559778 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd26b8a-d1a2-4e02-9e80-683740131aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:18:57.570897 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b136ba94-1fd9-4f0b-bd36-5140c7d3342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:18:57.752911 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b136ba94-1fd9-4f0b-bd36-5140c7d3342e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f46a667-d127-4702-8aba-e71d9caa3adf', 'volume_name': 'volume-6f46a667-d127-4702-8aba-e71d9caa3adf', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:18:57.767560 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b39c877-5ed3-4158-8e9e-c3da4408c590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:18:57.772329 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b39c877-5ed3-4158-8e9e-c3da4408c590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:18:57.787938 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911467dd-e6b6-4a69-9777-4b85e57622a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:18:57.791454 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Volume 6f46a667-d127-4702-8aba-e71d9caa3adf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f46a667-d127-4702-8aba-e71d9caa3adf', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:18:57.792379 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Cloning 6f46a667-d127-4702-8aba-e71d9caa3adf from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:18:57.796502 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:18:57.814913 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:18:57.832913 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 18, 57, 825464)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:18:57.833829 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:18:57.834944 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:18:57.845808 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.031s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:18:57.847399 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:18:57.877373 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 18, 57, 874459)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:18:57.878714 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:18:57.879771 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:18:57.932054 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:18:58.135101 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] creating snapshot='volume-6f46a667-d127-4702-8aba-e71d9caa3adf.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:18:59.063618 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-6f46a667-d127-4702-8aba-e71d9caa3adf.clone_snap' to 'volume-6f46a667-d127-4702-8aba-e71d9caa3adf' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:18:59.283613 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:18:59.284881 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:18:59.285247 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:18:59.309508 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:18:59.310359 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Marking volume 6f46a667-d127-4702-8aba-e71d9caa3adf as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:18:59.323139 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to 6f46a667-d127-4702-8aba-e71d9caa3adf. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:18:59.323791 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Creating volume glance metadata for volume 6f46a667-d127-4702-8aba-e71d9caa3adf backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:18:59.498487 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911467dd-e6b6-4a69-9777-4b85e57622a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f46a667-d127-4702-8aba-e71d9caa3adf', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:18:59.507311 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1431455b-40d2-4a2d-9cb5-21bff7868649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:18:59.533100 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Volume volume-6f46a667-d127-4702-8aba-e71d9caa3adf (6f46a667-d127-4702-8aba-e71d9caa3adf): created successfully Jul 30 21:18:59.537246 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1431455b-40d2-4a2d-9cb5-21bff7868649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:18:59.548297 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Flow 'volume_create_manager' (b99591ae-f97d-4573-842d-1473a8cca67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:18:59.571513 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-24ef1b8a-e91a-4701-acca-5b00de791957 tempest-TestVolumeBackupRestore-1734134401 None] Created volume successfully. Jul 30 21:19:01.825588 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-24f79e9c-3158-47fb-a683-126bb13f4935 tempest-TestVolumeBackupRestore-1734134401 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-30T21:19:01Z,data_timestamp=2022-07-30T21:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=cec51bbf-9aed-410c-9bf0-7015116bbca6,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='cd884e1c0861450e9049a966a5931675',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f4b80fe0ec404f0480948be6e051c9e4',volume_id=6f46a667-d127-4702-8aba-e71d9caa3adf) Jul 30 21:19:01.844075 ncdv-master-1 cinder-volume[124008]: INFO cinder.rpc [None req-24f79e9c-3158-47fb-a683-126bb13f4935 tempest-TestVolumeBackupRestore-1734134401 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jul 30 21:19:01.857669 ncdv-master-1 cinder-volume[124008]: INFO cinder.rpc [None req-24f79e9c-3158-47fb-a683-126bb13f4935 tempest-TestVolumeBackupRestore-1734134401 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Jul 30 21:19:01.860025 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.backup.rpcapi [None req-24f79e9c-3158-47fb-a683-126bb13f4935 tempest-TestVolumeBackupRestore-1734134401 None] continue_backup in rpcapi backup_id cec51bbf-9aed-410c-9bf0-7015116bbca6 {{(pid=124008) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jul 30 21:19:06.263803 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] Acquiring lock "cinder-60fb4518-f854-4b61-a759-7d8ecb213f83-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:19:06.282100 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] Lock "cinder-60fb4518-f854-4b61-a759-7d8ecb213f83-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:19:06.365338 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:06.446817 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:19:06.447640 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] Volume volume-60fb4518-f854-4b61-a759-7d8ecb213f83 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:19:06.465729 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] deleting rbd volume volume-60fb4518-f854-4b61-a759-7d8ecb213f83 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:19:07.169135 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] Created reservations ['a5459d97-4125-4488-ad49-19df2eecf8aa', 'd78ff66c-271a-4e9b-9949-0ad884987c0d', '7389fd75-5619-480a-aa0e-29d1d80518a1', '6714fcdb-4d0b-4986-9461-821b8d9f8225'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:19:07.245679 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:07.340677 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:07.480061 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:19:07.485650 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] Deleted volume successfully. Jul 30 21:19:07.514702 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-87ab18ef-de7c-4fdc-ba07-5cbe90f68527 tempest-TaggedBootDevicesTest-1391871096 None] Lock "cinder-60fb4518-f854-4b61-a759-7d8ecb213f83-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:19:07.595278 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] Acquiring lock "cinder-5bc23213-e140-4a12-b440-bd8f58b9cd96-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:19:07.616749 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] Lock "cinder-5bc23213-e140-4a12-b440-bd8f58b9cd96-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:19:07.730019 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:07.847093 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:19:07.847880 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] Volume volume-5bc23213-e140-4a12-b440-bd8f58b9cd96 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:19:07.883745 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] deleting rbd volume volume-5bc23213-e140-4a12-b440-bd8f58b9cd96 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:19:08.606986 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] Created reservations ['35e73926-b315-4bc4-9215-6387186569fd', '917d3182-b526-44ee-9bef-b5558d808818', '93c35663-9829-412d-9efe-3de11b4781fa', 'ace83f27-ce8f-4777-9b11-10c79c4af767'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:19:08.729409 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:08.874813 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:09.024548 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:19:09.031520 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] Acquiring lock "cinder-274b1600-813c-4727-aba9-36bcc9319a0c-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:19:09.041063 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] Deleted volume successfully. Jul 30 21:19:09.066746 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] Lock "cinder-274b1600-813c-4727-aba9-36bcc9319a0c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:19:09.112080 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c7a4f9aa-dd96-416e-b9f7-301b12bffde2 tempest-TaggedBootDevicesTest-1391871096 None] Lock "cinder-5bc23213-e140-4a12-b440-bd8f58b9cd96-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:19:09.191045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:09.331727 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:19:09.350065 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] deleting rbd volume volume-274b1600-813c-4727-aba9-36bcc9319a0c {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:19:09.998799 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:19:10.069655 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] deleting parent snapshot volume-274b1600-813c-4727-aba9-36bcc9319a0c.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:19:10.856345 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-24f79e9c-3158-47fb-a683-126bb13f4935 tempest-TestVolumeBackupRestore-1734134401 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:19:11.023606 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] Created reservations ['047e1a42-8a8f-4bb5-8390-9110fd4ec4f4', '3647afb5-2ff0-440b-8f82-9f9a2516f916', '97df70f9-d5cd-4299-8035-86416462a48d', 'ceb67b43-e19f-4708-861b-9f808886425e'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:19:11.052849 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=67,cinder:UPDATE=23,cinder:INSERT=8,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:11.068185 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=57,cinder:UPDATE=26,cinder:INSERT=16,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:11.163801 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:11.255906 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:11.358830 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:19:11.367469 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] Deleted volume successfully. Jul 30 21:19:11.401871 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c012313d-52ab-42d6-a32d-051761e9556a tempest-TaggedBootDevicesTest-1391871096 None] Lock "cinder-274b1600-813c-4727-aba9-36bcc9319a0c-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:19:12.366052 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-24f79e9c-3158-47fb-a683-126bb13f4935 tempest-TestVolumeBackupRestore-1734134401 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.510s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:19:12.368328 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-24f79e9c-3158-47fb-a683-126bb13f4935 tempest-TestVolumeBackupRestore-1734134401 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6f46a667-d127-4702-8aba-e71d9caa3adf', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '6f46a667-d127-4702-8aba-e71d9caa3adf', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:19:12.395700 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-24f79e9c-3158-47fb-a683-126bb13f4935 tempest-TestVolumeBackupRestore-1734134401 None] Initialize volume connection completed successfully. Jul 30 21:19:15.951897 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:19:15.953466 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:16.030394 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:16.111338 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:19:23.371911 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:25.540937 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-24f79e9c-3158-47fb-a683-126bb13f4935 tempest-TestVolumeBackupRestore-1734134401 None] Terminate volume connection completed successfully. Jul 30 21:19:25.586284 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-24f79e9c-3158-47fb-a683-126bb13f4935 tempest-TestVolumeBackupRestore-1734134401 None] Remove volume export completed successfully. Jul 30 21:19:26.669563 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:19:26.702072 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Flow 'volume_create_manager' (933490ec-7cfb-47fc-a74e-aac870f80292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:19:26.711954 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a45f2c-63a3-4109-87a5-8af7052bc495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:19:26.734580 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a45f2c-63a3-4109-87a5-8af7052bc495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:19:26Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_cec51bbf-9aed-410c-9bf0-7015116bbca6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f212dba-2e86-4b92-94b3-0b7efa892285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd884e1c0861450e9049a966a5931675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:19:27Z,use_quota=True,user_id='f4b80fe0ec404f0480948be6e051c9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:19:26.744067 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a06ef9f-ab2e-4e41-ac18-b812198415ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:19:26.749423 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a06ef9f-ab2e-4e41-ac18-b812198415ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:19:26.757086 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f0a2ce-8db9-45af-993f-286b74063c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:19:26.762736 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f0a2ce-8db9-45af-993f-286b74063c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f212dba-2e86-4b92-94b3-0b7efa892285', 'volume_name': 'volume-4f212dba-2e86-4b92-94b3-0b7efa892285', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:19:26.770205 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6900679b-090f-41be-ace8-664e9dfdf5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:19:26.778053 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6900679b-090f-41be-ace8-664e9dfdf5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:19:26.786353 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b02707a-3656-4dfa-9a5d-497f42573baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:19:26.788680 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Volume 4f212dba-2e86-4b92-94b3-0b7efa892285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f212dba-2e86-4b92-94b3-0b7efa892285', 'volume_size': 1} Jul 30 21:19:26.789518 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] creating volume 'volume-4f212dba-2e86-4b92-94b3-0b7efa892285' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:19:26.790683 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:27.012816 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:19:27.013241 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:19:27.019495 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b02707a-3656-4dfa-9a5d-497f42573baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f212dba-2e86-4b92-94b3-0b7efa892285', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:19:27.026969 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e215265-d7d4-4247-bb5f-4e60786e9bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:19:27.050129 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Volume volume-4f212dba-2e86-4b92-94b3-0b7efa892285 (4f212dba-2e86-4b92-94b3-0b7efa892285): created successfully Jul 30 21:19:27.061564 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e215265-d7d4-4247-bb5f-4e60786e9bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:19:27.070974 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Flow 'volume_create_manager' (933490ec-7cfb-47fc-a74e-aac870f80292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:19:27.086656 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Created volume successfully. Jul 30 21:19:27.857678 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:19:29.279235 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.421s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:19:29.281346 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4f212dba-2e86-4b92-94b3-0b7efa892285', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '4f212dba-2e86-4b92-94b3-0b7efa892285', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:19:29.329118 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Initialize volume connection completed successfully. Jul 30 21:19:30.393067 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] Acquiring lock "cinder-48078879-4d0f-4421-a875-29cf671cc11a-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:19:30.423722 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] Lock "cinder-48078879-4d0f-4421-a875-29cf671cc11a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:19:30.537989 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:30.664500 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:19:30.665870 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] Volume volume-48078879-4d0f-4421-a875-29cf671cc11a is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:19:30.757879 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] deleting rbd volume volume-48078879-4d0f-4421-a875-29cf671cc11a {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:19:32.091714 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] Created reservations ['774d181c-d341-44fa-a602-a9853eef4d4c', 'c60607dd-915c-44a2-a632-37f2b8cdd4fb', 'd90439a8-799d-498d-a225-a6d8a9227e84', '51a5f775-f242-4d07-916c-dac9cc5f2acc'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:19:32.282746 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:32.365999 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:32.427533 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:19:32.440932 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] Deleted volume successfully. Jul 30 21:19:32.465210 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-644b5a28-9781-46b4-b79d-dd7a3a750908 tempest-ServersNegativeTestJSON-1663379598 None] Lock "cinder-48078879-4d0f-4421-a875-29cf671cc11a-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:19:32.767597 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] Acquiring lock "cinder-db10433c-ccc0-4fb5-b776-13e3bc933f4f-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:19:32.790721 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] Lock "cinder-db10433c-ccc0-4fb5-b776-13e3bc933f4f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:19:32.849512 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:32.981601 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:19:32.982432 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] Volume volume-db10433c-ccc0-4fb5-b776-13e3bc933f4f is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:19:33.032656 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] deleting rbd volume volume-db10433c-ccc0-4fb5-b776-13e3bc933f4f {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:19:34.512631 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] Created reservations ['d4d99fc9-09cf-4f70-952b-d3b96ba53a8e', '900f1510-486d-48c4-a1df-497575eba0bc', 'db2535b2-f9da-46ca-82dc-5457b090835a', '853a2e9d-6932-4070-8b1b-5b6be4b925b8'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:19:34.642073 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:34.693752 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:19:34.809097 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:19:34.824061 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] Deleted volume successfully. Jul 30 21:19:34.859278 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-e8efd45e-6e0c-4dcd-9ec2-a8c96a3395d8 tempest-ServersNegativeTestJSON-1663379598 None] Lock "cinder-db10433c-ccc0-4fb5-b776-13e3bc933f4f-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:19:37.371516 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Terminate volume connection completed successfully. Jul 30 21:19:37.426540 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c3d7c258-2a72-4c48-b286-18db96569c2b tempest-TestVolumeBackupRestore-1734134401 None] Remove volume export completed successfully. Jul 30 21:19:43.378249 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=22,cinder:SELECT=52,cinder:DELETE=1,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:19:49.824483 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 req-af972bd6-e94b-4597-baf9-44404cca4969 tempest-TestVolumeBackupRestore-1734134401 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:19:52.086766 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 req-af972bd6-e94b-4597-baf9-44404cca4969 tempest-TestVolumeBackupRestore-1734134401 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.262s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:19:52.087838 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 req-af972bd6-e94b-4597-baf9-44404cca4969 tempest-TestVolumeBackupRestore-1734134401 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4f212dba-2e86-4b92-94b3-0b7efa892285', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '4f212dba-2e86-4b92-94b3-0b7efa892285', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:19:52.154743 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 req-af972bd6-e94b-4597-baf9-44404cca4969 tempest-TestVolumeBackupRestore-1734134401 None] Connection info returned from driver {'name': 'volumes/volume-4f212dba-2e86-4b92-94b3-0b7efa892285', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4f212dba-2e86-4b92-94b3-0b7efa892285', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '40c9c6a4-f62c-4452-9d91-569bc42359a5'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:19:52.324045 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-57d2ed52-a9e0-4ad4-937d-3f97aa92d716 req-af972bd6-e94b-4597-baf9-44404cca4969 tempest-TestVolumeBackupRestore-1734134401 None] attachment_update completed successfully. Jul 30 21:20:03.364766 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=43,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:10.931825 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:20:10.953705 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Flow 'volume_create_manager' (46a30e15-e777-406e-90ba-7584b1c10d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:20:10.961382 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca1dd85-7251-4354-9387-317d2265e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:20:10.992288 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca1dd85-7251-4354-9387-317d2265e48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2107818118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=64c8a78a-07e4-44a0-a9a7-5e0dd26dd400,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e51697dcd2494de8b5490f69ff651744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:20:11Z,use_quota=True,user_id='7e4674f50d704f93a4c488a7c83056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:20:10.998155 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4497981b-ddc5-4d5c-9ab0-f0cacb5db8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:20:11.002328 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4497981b-ddc5-4d5c-9ab0-f0cacb5db8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:20:11.020218 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60776bd3-d96a-452f-bac6-dd6c1d4bdbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:20:11.024157 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60776bd3-d96a-452f-bac6-dd6c1d4bdbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c8a78a-07e4-44a0-a9a7-5e0dd26dd400', 'volume_name': 'volume-64c8a78a-07e4-44a0-a9a7-5e0dd26dd400', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:20:11.033384 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449fa778-cde6-44fa-803e-5de63c20bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:20:11.046934 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449fa778-cde6-44fa-803e-5de63c20bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:20:11.052137 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4307d57b-c0b9-400f-8801-08480c1a1e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:20:11.052932 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Volume 64c8a78a-07e4-44a0-a9a7-5e0dd26dd400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c8a78a-07e4-44a0-a9a7-5e0dd26dd400', 'volume_size': 1} Jul 30 21:20:11.053275 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] creating volume 'volume-64c8a78a-07e4-44a0-a9a7-5e0dd26dd400' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:20:11.054435 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:20:11.223504 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:20:11.224154 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:20:11.228501 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4307d57b-c0b9-400f-8801-08480c1a1e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c8a78a-07e4-44a0-a9a7-5e0dd26dd400', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:20:11.245295 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787761fa-f568-4461-9277-769313c16bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:20:11.279114 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Volume volume-64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 (64c8a78a-07e4-44a0-a9a7-5e0dd26dd400): created successfully Jul 30 21:20:11.289082 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787761fa-f568-4461-9277-769313c16bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:20:11.308775 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Flow 'volume_create_manager' (46a30e15-e777-406e-90ba-7584b1c10d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:20:11.332694 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-a53ef47d-e21a-4475-ae44-e191394bb9e8 req-4f2f241f-b70c-4884-9f35-3c73389b438f tempest-VolumesGetTestJSON-253130318 None] Created volume successfully. Jul 30 21:20:12.454033 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] Acquiring lock "cinder-64c8a78a-07e4-44a0-a9a7-5e0dd26dd400-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:20:12.474500 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] Lock "cinder-64c8a78a-07e4-44a0-a9a7-5e0dd26dd400-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:20:12.578366 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:20:12.694367 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:20:12.695183 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] Volume volume-64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:20:12.721750 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] deleting rbd volume volume-64c8a78a-07e4-44a0-a9a7-5e0dd26dd400 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:20:13.721504 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=27,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:13.864129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] Created reservations ['e77f66a5-969b-410b-a072-9b305290ad91', '9265fea1-fa88-4c57-8f10-01c42f8ce4cb', '64658eb2-a413-498a-b1c3-7fd1e861c585', '13c316e8-cb6e-4586-a168-d6df212475f3'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:20:14.064507 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:20:14.159655 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:20:14.265177 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:20:14.271554 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] Deleted volume successfully. Jul 30 21:20:14.380464 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-7c31eef5-090c-4986-9055-dc9e48db8de2 req-b0f76b0a-80a0-4d33-b7f8-4d529685bd74 tempest-VolumesGetTestJSON-253130318 None] Lock "cinder-64c8a78a-07e4-44a0-a9a7-5e0dd26dd400-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:20:15.957381 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:20:15.958107 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:20:16.034956 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:20:16.124812 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:20:43.371788 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=21,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:20:53.369225 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=13 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:23.370743 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:25.288457 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-0d5c438f-4794-4893-a2b2-9bbdf7fa133f req-860882b0-8fb3-4816-870f-b7e1220bb9f2 tempest-TestVolumeBackupRestore-1734134401 None] Terminate volume connection completed successfully. Jul 30 21:21:25.289111 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-0d5c438f-4794-4893-a2b2-9bbdf7fa133f req-860882b0-8fb3-4816-870f-b7e1220bb9f2 tempest-TestVolumeBackupRestore-1734134401 None] Deleting attachment 40c9c6a4-f62c-4452-9d91-569bc42359a5. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:21:26.705024 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] Acquiring lock "cinder-4f212dba-2e86-4b92-94b3-0b7efa892285-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:21:26.727399 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] Lock "cinder-4f212dba-2e86-4b92-94b3-0b7efa892285-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:21:26.804219 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:21:27.313372 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] Volume volume-4f212dba-2e86-4b92-94b3-0b7efa892285 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:21:27.383455 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] deleting rbd volume volume-4f212dba-2e86-4b92-94b3-0b7efa892285 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:21:27.392834 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] Acquiring lock "cinder-6f46a667-d127-4702-8aba-e71d9caa3adf-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:21:27.416466 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] Lock "cinder-6f46a667-d127-4702-8aba-e71d9caa3adf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:21:27.515035 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:21:28.438903 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] deleting rbd volume volume-6f46a667-d127-4702-8aba-e71d9caa3adf {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:21:28.656748 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] Created reservations ['c8c41e5a-2524-4859-803e-b99a0e3dbdd3', 'b9333f53-0cd6-47e8-8fda-58e1f789ce07', '66e924fa-9757-4d23-a5a0-617648cb247d', '9d0e6721-e216-49bb-8c70-70dd2a53bffe'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:21:28.751641 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:21:28.821671 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:21:28.889259 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:21:28.892655 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:21:28.950332 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] deleting parent snapshot volume-6f46a667-d127-4702-8aba-e71d9caa3adf.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:21:29.388332 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] Deleted volume successfully. Jul 30 21:21:29.430395 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3e933971-67f4-47d1-97bb-41031da9ba0c tempest-TestVolumeBackupRestore-1734134401 None] Lock "cinder-4f212dba-2e86-4b92-94b3-0b7efa892285-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:21:29.498438 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] Created reservations ['6227fde6-de2a-4e0f-9ab1-7d84f7fb0b06', '2a2df4e0-14f4-4dcf-a32d-8677ea2b9740', 'aa99b7ec-8915-4371-a43e-cbef8e6d6e28', 'bea81714-2d47-439a-a3f7-63687e5471a4'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:21:29.644244 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:21:29.707056 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:21:29.776525 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:21:29.781937 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] Deleted volume successfully. Jul 30 21:21:29.850274 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-494ceadb-a270-4242-84c0-c8000ffd295c tempest-TestVolumeBackupRestore-1734134401 None] Lock "cinder-6f46a667-d127-4702-8aba-e71d9caa3adf-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:21:43.384271 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=39,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:21:44.847163 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:21:44.923004 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Flow 'volume_create_manager' (fe7db183-6de7-42eb-ab94-f1e3d2fdbe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:21:44.936516 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b8982b-4b4a-4344-9c8d-d7771550fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:21:44.972011 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b8982b-4b4a-4344-9c8d-d7771550fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-339310750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4d160b1f-adc0-4cd3-9332-a6767a4098c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5850a54af6204e2f83d8e61141a04013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:21:45Z,use_quota=True,user_id='6896ccb6369541d5a552f3373f39c64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:21:44.983857 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecec355a-2bbd-4092-8fd5-2608426253b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:21:45.001305 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecec355a-2bbd-4092-8fd5-2608426253b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:21:45.018159 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a56e17-89b4-4078-bf0e-d465266ada75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:21:45.025282 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a56e17-89b4-4078-bf0e-d465266ada75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d160b1f-adc0-4cd3-9332-a6767a4098c9', 'volume_name': 'volume-4d160b1f-adc0-4cd3-9332-a6767a4098c9', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:21:45.032933 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd371585-7d37-4414-8308-942ae9f71a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:21:45.037482 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd371585-7d37-4414-8308-942ae9f71a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:21:45.043323 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4223df3f-ee5d-485f-818d-23a1e1d5632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:21:45.045759 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Volume 4d160b1f-adc0-4cd3-9332-a6767a4098c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d160b1f-adc0-4cd3-9332-a6767a4098c9', 'volume_size': 1} Jul 30 21:21:45.046327 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] creating volume 'volume-4d160b1f-adc0-4cd3-9332-a6767a4098c9' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:21:45.047451 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:21:45.261443 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:21:45.261860 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:21:45.275409 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4223df3f-ee5d-485f-818d-23a1e1d5632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d160b1f-adc0-4cd3-9332-a6767a4098c9', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:21:45.288724 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f48db6-bd79-466e-a786-5f9db0c3e8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:21:45.318058 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Volume volume-4d160b1f-adc0-4cd3-9332-a6767a4098c9 (4d160b1f-adc0-4cd3-9332-a6767a4098c9): created successfully Jul 30 21:21:45.323456 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f48db6-bd79-466e-a786-5f9db0c3e8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:21:45.333890 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Flow 'volume_create_manager' (fe7db183-6de7-42eb-ab94-f1e3d2fdbe45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:21:45.361191 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-647fa40e-a458-4e72-9bd0-e3d459303278 tempest-AttachVolumeNegativeTest-1386881426 None] Created volume successfully. Jul 30 21:21:46.640586 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e req-cea73601-7eb5-4fef-a506-418a52a2d40b tempest-AttachVolumeNegativeTest-1386881426 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:21:47.719631 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e req-cea73601-7eb5-4fef-a506-418a52a2d40b tempest-AttachVolumeNegativeTest-1386881426 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.078s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:21:47.721553 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e req-cea73601-7eb5-4fef-a506-418a52a2d40b tempest-AttachVolumeNegativeTest-1386881426 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4d160b1f-adc0-4cd3-9332-a6767a4098c9', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '4d160b1f-adc0-4cd3-9332-a6767a4098c9', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:21:47.758648 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e req-cea73601-7eb5-4fef-a506-418a52a2d40b tempest-AttachVolumeNegativeTest-1386881426 None] Connection info returned from driver {'name': 'volumes/volume-4d160b1f-adc0-4cd3-9332-a6767a4098c9', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4d160b1f-adc0-4cd3-9332-a6767a4098c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8893b57f-8d96-43ed-9943-1fc110672b2e'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:21:47.841837 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-d2b71ed8-2997-4d79-a1f2-c30dfc1c988e req-cea73601-7eb5-4fef-a506-418a52a2d40b tempest-AttachVolumeNegativeTest-1386881426 None] attachment_update completed successfully. Jul 30 21:22:03.387950 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=41,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:13.401787 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=18,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:15.962780 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:22:15.968648 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:22:16.066608 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:22:16.126817 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:22:23.435868 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:43.413801 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:53.408536 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:22:54.199177 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-bda39e84-1641-4984-9656-6eafec2c8e48 req-762dd16c-f564-467f-adce-2500d5d77f1c tempest-TaggedBootDevicesTest_v242-1264652532 None] Terminate volume connection completed successfully. Jul 30 21:22:54.200104 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-bda39e84-1641-4984-9656-6eafec2c8e48 req-762dd16c-f564-467f-adce-2500d5d77f1c tempest-TaggedBootDevicesTest_v242-1264652532 None] Deleting attachment faf38dc3-5305-418e-b43b-0e1c120356cd. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:22:54.398830 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-bda39e84-1641-4984-9656-6eafec2c8e48 req-a5a91181-ec20-4cdc-81c4-ea56129e3730 tempest-TaggedBootDevicesTest_v242-1264652532 None] Terminate volume connection completed successfully. Jul 30 21:22:54.399715 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-bda39e84-1641-4984-9656-6eafec2c8e48 req-a5a91181-ec20-4cdc-81c4-ea56129e3730 tempest-TaggedBootDevicesTest_v242-1264652532 None] Deleting attachment b9312807-38e9-497d-ab5c-a2678b1ca024. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:22:54.629657 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-bda39e84-1641-4984-9656-6eafec2c8e48 req-cfbd471a-3efd-4be2-b5f0-93beea6ffe65 tempest-TaggedBootDevicesTest_v242-1264652532 None] Terminate volume connection completed successfully. Jul 30 21:22:54.631696 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-bda39e84-1641-4984-9656-6eafec2c8e48 req-cfbd471a-3efd-4be2-b5f0-93beea6ffe65 tempest-TaggedBootDevicesTest_v242-1264652532 None] Deleting attachment 0a06feb5-645c-4d3d-b0ea-3a1bdde8b504. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:23:01.242869 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-7a3ee53a-6fec-47e9-aa38-af0811efb66c req-d52b8799-cfd5-4e94-a44d-40b1a15a4320 tempest-AttachVolumeNegativeTest-1386881426 None] Terminate volume connection completed successfully. Jul 30 21:23:01.244059 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-7a3ee53a-6fec-47e9-aa38-af0811efb66c req-d52b8799-cfd5-4e94-a44d-40b1a15a4320 tempest-AttachVolumeNegativeTest-1386881426 None] Deleting attachment 8893b57f-8d96-43ed-9943-1fc110672b2e. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:23:06.232338 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] Acquiring lock "cinder-35b2a01c-5c18-4761-974d-a4089f62e4a3-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:23:06.261695 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] Lock "cinder-35b2a01c-5c18-4761-974d-a4089f62e4a3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:23:06.339280 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:06.464133 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:23:06.465400 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume volume-35b2a01c-5c18-4761-974d-a4089f62e4a3 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:23:06.487756 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] deleting rbd volume volume-35b2a01c-5c18-4761-974d-a4089f62e4a3 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:23:07.062077 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] Created reservations ['94f4cc8a-bc5d-4ce8-bf4e-4c9ade975dab', '0f3e343b-93ed-4830-8a84-5841e082da06', '4bcf87af-3198-40ba-aa74-f592c03ef4f1', '4fcd4ed3-b5fd-49d6-ab6e-d396566b1ce9'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:23:07.169285 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:07.252362 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:07.315240 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:23:07.327040 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] Deleted volume successfully. Jul 30 21:23:07.343191 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-eaa3d3a5-d912-4427-8a8d-bb90c564486b tempest-TaggedBootDevicesTest_v242-1264652532 None] Lock "cinder-35b2a01c-5c18-4761-974d-a4089f62e4a3-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:23:07.490983 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] Acquiring lock "cinder-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:23:07.505695 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] Lock "cinder-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:23:07.611192 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:07.692980 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:23:07.693397 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] Volume volume-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:23:07.700838 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] deleting rbd volume volume-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:23:07.997650 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] Created reservations ['e7997fd2-c9fa-4517-bea1-8bd2024626f4', 'baa97dbf-805f-484f-844d-5463e58bc4a1', '5f04fb6f-9c6e-463b-8ff2-5f20815f1f40', '6b409bdf-c18c-48ab-a9ad-5fea00e8b1b5'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:23:08.058041 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:08.115208 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:08.183912 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:23:08.198090 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] Deleted volume successfully. Jul 30 21:23:08.217862 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1b8ea030-5470-455c-ba10-ef7c3e14853c tempest-TaggedBootDevicesTest_v242-1264652532 None] Lock "cinder-0e3e52bb-c8b5-4e24-ada0-08f0ff72f891-delete_volume" released by "delete_volume" :: held 0.712s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:23:08.763470 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] Acquiring lock "cinder-1a378643-26a9-4022-b012-defa76e4082f-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:23:08.782460 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] Lock "cinder-1a378643-26a9-4022-b012-defa76e4082f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:23:08.846288 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:08.963669 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:23:08.980176 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] deleting rbd volume volume-1a378643-26a9-4022-b012-defa76e4082f {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:23:09.241031 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:23:09.275655 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] deleting parent snapshot volume-1a378643-26a9-4022-b012-defa76e4082f.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:23:10.000502 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] Created reservations ['a18453f5-db31-46c0-b0d8-1466a345db97', '5988eb53-e4ae-48de-a47f-eaf79846f81e', '6f012491-9965-4a88-9c44-aa816687c871', '9bef2282-2695-48f4-a4b3-5f2fef772c99'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:23:10.118861 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:10.164503 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:10.220116 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:23:10.225330 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] Deleted volume successfully. Jul 30 21:23:10.240655 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-2decbd71-73ab-4b33-b46e-591e53a1304b tempest-TaggedBootDevicesTest_v242-1264652532 None] Lock "cinder-1a378643-26a9-4022-b012-defa76e4082f-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:23:15.965567 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:23:15.967863 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:16.027685 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:23:16.093312 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:23:23.423421 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=51,cinder:UPDATE=31,cinder:INSERT=10,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:23:23.429777 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=48,cinder:UPDATE=20,cinder:DELETE=1,cinder:INSERT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:03.405694 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=4,cinder:SELECT=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:03.408537 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:15.968853 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:24:15.969559 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:24:16.064911 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:24:16.132118 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:24:17.626090 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:24:17.647130 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Flow 'volume_create_manager' (be38a21a-e9d6-4675-9e1e-b332b68bafe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:24:17.654602 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98333aa-d03e-46a6-9710-577b76288c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:24:17.673809 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98333aa-d03e-46a6-9710-577b76288c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-6156511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4626f264-6101-4b93-9bbf-7c9a5c6b3f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5850a54af6204e2f83d8e61141a04013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:24:18Z,use_quota=True,user_id='6896ccb6369541d5a552f3373f39c64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:24:17.679722 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74a1fcd-e937-4477-b0ed-6d2a11082703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:24:17.685770 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74a1fcd-e937-4477-b0ed-6d2a11082703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:24:17.691701 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c8e71d-3676-4bc4-a0ad-87909d95841c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:24:17.696289 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c8e71d-3676-4bc4-a0ad-87909d95841c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4626f264-6101-4b93-9bbf-7c9a5c6b3f81', 'volume_name': 'volume-4626f264-6101-4b93-9bbf-7c9a5c6b3f81', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:24:17.701776 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edebe478-696d-43f7-a28d-2088103c7ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:24:17.706868 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edebe478-696d-43f7-a28d-2088103c7ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:24:17.712974 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39fcf47-208d-40eb-9949-82d065709543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:24:17.717762 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Volume 4626f264-6101-4b93-9bbf-7c9a5c6b3f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4626f264-6101-4b93-9bbf-7c9a5c6b3f81', 'volume_size': 1} Jul 30 21:24:17.718541 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] creating volume 'volume-4626f264-6101-4b93-9bbf-7c9a5c6b3f81' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:24:17.719656 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:24:17.849469 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:24:17.850259 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:24:17.856472 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39fcf47-208d-40eb-9949-82d065709543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4626f264-6101-4b93-9bbf-7c9a5c6b3f81', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:24:17.868555 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3058e8f2-3e6f-438b-9440-98141e9688ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:24:17.895207 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Volume volume-4626f264-6101-4b93-9bbf-7c9a5c6b3f81 (4626f264-6101-4b93-9bbf-7c9a5c6b3f81): created successfully Jul 30 21:24:17.903642 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3058e8f2-3e6f-438b-9440-98141e9688ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:24:17.919812 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Flow 'volume_create_manager' (be38a21a-e9d6-4675-9e1e-b332b68bafe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:24:17.932247 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-696fc375-8653-4f9e-8d5a-331f6944c683 tempest-AttachVolumeNegativeTest-1386881426 None] Created volume successfully. Jul 30 21:24:19.471169 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-4d63f8e1-d744-40a1-8a9e-705c97740c01 req-b87f35ce-d363-4359-89af-3a309ed80d7b tempest-AttachVolumeNegativeTest-1386881426 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:24:20.906927 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-4d63f8e1-d744-40a1-8a9e-705c97740c01 req-b87f35ce-d363-4359-89af-3a309ed80d7b tempest-AttachVolumeNegativeTest-1386881426 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.435s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:24:20.910170 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-4d63f8e1-d744-40a1-8a9e-705c97740c01 req-b87f35ce-d363-4359-89af-3a309ed80d7b tempest-AttachVolumeNegativeTest-1386881426 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4626f264-6101-4b93-9bbf-7c9a5c6b3f81', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '4626f264-6101-4b93-9bbf-7c9a5c6b3f81', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:24:20.979392 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-4d63f8e1-d744-40a1-8a9e-705c97740c01 req-b87f35ce-d363-4359-89af-3a309ed80d7b tempest-AttachVolumeNegativeTest-1386881426 None] Connection info returned from driver {'name': 'volumes/volume-4626f264-6101-4b93-9bbf-7c9a5c6b3f81', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4626f264-6101-4b93-9bbf-7c9a5c6b3f81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9bf3e92d-f610-4237-9b70-59bc8780a529'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:24:21.099014 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-4d63f8e1-d744-40a1-8a9e-705c97740c01 req-b87f35ce-d363-4359-89af-3a309ed80d7b tempest-AttachVolumeNegativeTest-1386881426 None] attachment_update completed successfully. Jul 30 21:24:24.317827 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-871a09e1-86fd-4318-a7f9-d17917847255 req-70ac596d-fe56-4e3a-b584-c723ef99bea1 tempest-AttachVolumeNegativeTest-1386881426 None] Terminate volume connection completed successfully. Jul 30 21:24:24.319139 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-871a09e1-86fd-4318-a7f9-d17917847255 req-70ac596d-fe56-4e3a-b584-c723ef99bea1 tempest-AttachVolumeNegativeTest-1386881426 None] Deleting attachment 9bf3e92d-f610-4237-9b70-59bc8780a529. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:24:43.419048 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=19,cinder:UPDATE=7 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:24:43.430264 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=27,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:15.968397 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:25:15.969603 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:25:16.055839 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:25:16.152033 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:25:23.417854 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:23.419068 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:49.084547 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:25:49.140429 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Flow 'volume_create_manager' (2b8a54c7-f639-440a-b025-533731cd7012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:25:49.162271 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc171a0-6563-4922-bb25-735f466511c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:25:49.195541 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc171a0-6563-4922-bb25-735f466511c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1138834712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5850a54af6204e2f83d8e61141a04013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:25:49Z,use_quota=True,user_id='6896ccb6369541d5a552f3373f39c64d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:25:49.207555 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7305498d-4562-4af0-9a7f-73f7535a34d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:25:49.217831 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7305498d-4562-4af0-9a7f-73f7535a34d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:25:49.235490 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223625f1-0df7-4baa-a140-ed0e799fc935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:25:49.247978 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223625f1-0df7-4baa-a140-ed0e799fc935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4', 'volume_name': 'volume-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:25:49.257787 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896cbeb5-4e5f-404c-8f77-8099ac3f4c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:25:49.266395 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896cbeb5-4e5f-404c-8f77-8099ac3f4c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:25:49.287102 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffab8a3f-f008-4649-a63b-5853246bc692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:25:49.288636 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Volume 7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4', 'volume_size': 1} Jul 30 21:25:49.291612 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] creating volume 'volume-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:25:49.292484 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:25:49.412009 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:25:49.412667 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:25:49.416993 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffab8a3f-f008-4649-a63b-5853246bc692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:25:49.424975 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d63610-e932-484f-885c-3f82e9cc4c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:25:49.457810 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Volume volume-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4 (7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4): created successfully Jul 30 21:25:49.462628 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d63610-e932-484f-885c-3f82e9cc4c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:25:49.470693 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Flow 'volume_create_manager' (2b8a54c7-f639-440a-b025-533731cd7012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:25:49.488190 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3b3bda34-7df5-470d-82a4-63d34de3fc97 tempest-AttachVolumeNegativeTest-1386881426 None] Created volume successfully. Jul 30 21:25:50.906619 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d req-4d127323-84f3-4a5e-b90f-7450d70b0cc0 tempest-AttachVolumeNegativeTest-1386881426 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:25:52.175320 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d req-4d127323-84f3-4a5e-b90f-7450d70b0cc0 tempest-AttachVolumeNegativeTest-1386881426 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.268s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:25:52.177068 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d req-4d127323-84f3-4a5e-b90f-7450d70b0cc0 tempest-AttachVolumeNegativeTest-1386881426 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:25:52.240948 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d req-4d127323-84f3-4a5e-b90f-7450d70b0cc0 tempest-AttachVolumeNegativeTest-1386881426 None] Connection info returned from driver {'name': 'volumes/volume-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0f17960f-3936-4c48-b6e6-66352e9fb474'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:25:52.359532 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-7e69baa4-69d2-40dc-b17f-d024bf92ee8d req-4d127323-84f3-4a5e-b90f-7450d70b0cc0 tempest-AttachVolumeNegativeTest-1386881426 None] attachment_update completed successfully. Jul 30 21:25:55.582340 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=21,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:55.585598 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=21,cinder:UPDATE=6 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:25:55.612589 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-e7df69f0-5c59-4ff6-83a6-a219d9ab2f73 req-322de43e-4c08-4aeb-ac17-aa62ed36b0bf tempest-AttachVolumeNegativeTest-1386881426 None] Terminate volume connection completed successfully. Jul 30 21:25:55.613033 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-e7df69f0-5c59-4ff6-83a6-a219d9ab2f73 req-322de43e-4c08-4aeb-ac17-aa62ed36b0bf tempest-AttachVolumeNegativeTest-1386881426 None] Deleting attachment 0f17960f-3936-4c48-b6e6-66352e9fb474. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:26:08.413870 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] Acquiring lock "cinder-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:26:08.437176 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] Lock "cinder-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:26:08.511827 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:08.688110 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:26:08.688831 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] Volume volume-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:26:08.719245 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] deleting rbd volume volume-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:26:09.210146 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] Created reservations ['16a4d8ac-e0f5-447f-b1a6-b66d9fd65d9d', 'aeece1b0-2566-4424-8f08-d274d9a96b21', '7b489092-bc2c-485d-b206-2c0936074944', 'b192288c-7ce0-4a42-9bb3-678b8d90cf6b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:26:09.280014 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:09.336498 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:09.395212 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:26:09.400138 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] Deleted volume successfully. Jul 30 21:26:09.423671 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-20d47811-b944-4863-b1a7-e7b2a9a6683b tempest-AttachVolumeNegativeTest-1386881426 None] Lock "cinder-7f7384bf-f9cd-4fb6-ae87-f027ce60b3c4-delete_volume" released by "delete_volume" :: held 0.986s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:26:09.841951 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] Acquiring lock "cinder-4626f264-6101-4b93-9bbf-7c9a5c6b3f81-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:26:09.856586 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] Lock "cinder-4626f264-6101-4b93-9bbf-7c9a5c6b3f81-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:26:09.938982 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:10.058679 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:26:10.059670 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] Volume volume-4626f264-6101-4b93-9bbf-7c9a5c6b3f81 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:26:10.069800 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] deleting rbd volume volume-4626f264-6101-4b93-9bbf-7c9a5c6b3f81 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:26:10.501678 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] Created reservations ['c7d6b282-e521-4597-a2f6-ce413420e6c4', '32515e5c-a01c-421d-a94c-34203dc21846', '74be3ae5-e7b5-4af7-bf64-7b4e2f7ec2aa', '82e1b1d8-f2ca-43df-bc26-dd21216f8d92'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:26:10.596355 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:10.669968 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:10.748901 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:26:10.754581 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] Deleted volume successfully. Jul 30 21:26:10.782804 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b7c35d51-7c2e-4074-96f8-9d9fc6cef689 tempest-AttachVolumeNegativeTest-1386881426 None] Lock "cinder-4626f264-6101-4b93-9bbf-7c9a5c6b3f81-delete_volume" released by "delete_volume" :: held 0.926s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:26:11.409033 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] Acquiring lock "cinder-4d160b1f-adc0-4cd3-9332-a6767a4098c9-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:26:11.433498 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] Lock "cinder-4d160b1f-adc0-4cd3-9332-a6767a4098c9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:26:11.552999 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:11.625468 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:26:11.625969 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] Volume volume-4d160b1f-adc0-4cd3-9332-a6767a4098c9 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:26:11.634859 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] deleting rbd volume volume-4d160b1f-adc0-4cd3-9332-a6767a4098c9 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:26:12.104955 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] Created reservations ['8a903239-fdac-4d97-a8e4-aed31541c226', 'f0cd9ff8-4b1c-43b3-8064-46e9d430586e', '5b37a5d8-fb6b-483c-8fe5-2531f70fe43c', 'bf4b701d-3008-45fe-8d5c-ab93b4abeca0'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:26:12.198994 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:12.279591 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:12.346159 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:26:12.360439 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] Deleted volume successfully. Jul 30 21:26:12.383396 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1b795b96-bed9-43bf-9273-6f9bfffbbc5e tempest-AttachVolumeNegativeTest-1386881426 None] Lock "cinder-4d160b1f-adc0-4cd3-9332-a6767a4098c9-delete_volume" released by "delete_volume" :: held 0.950s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:26:15.967641 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:26:15.968665 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:16.046526 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:26:16.133167 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:26:23.426091 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=45,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:26:43.428956 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=40,cinder:INSERT=6,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:03.424302 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:09.274136 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-630d7462-046b-4794-a82b-a0ba517ff7d3 tempest-GroupsV320Test-1052261739 None] Group tempest-GroupsV320Test-Group-322876401: creating Jul 30 21:27:09.311772 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-630d7462-046b-4794-a82b-a0ba517ff7d3 tempest-GroupsV320Test-1052261739 None] Group tempest-GroupsV320Test-Group-322876401: created successfully Jul 30 21:27:09.323219 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-630d7462-046b-4794-a82b-a0ba517ff7d3 tempest-GroupsV320Test-1052261739 None] Create group completed successfully. Jul 30 21:27:11.311892 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-ed6d9d72-16e6-49be-b3c2-f9258438d15b tempest-GroupsV320Test-1052261739 None] Created reservations ['865c6771-0361-4870-86d4-4564f2938e86'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:27:11.377927 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ed6d9d72-16e6-49be-b3c2-f9258438d15b tempest-GroupsV320Test-1052261739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:11.450752 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ed6d9d72-16e6-49be-b3c2-f9258438d15b tempest-GroupsV320Test-1052261739 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:11.518792 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-ed6d9d72-16e6-49be-b3c2-f9258438d15b tempest-GroupsV320Test-1052261739 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:27:11.522994 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-ed6d9d72-16e6-49be-b3c2-f9258438d15b tempest-GroupsV320Test-1052261739 None] Delete group completed successfully. Jul 30 21:27:15.968402 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:27:15.969061 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:16.066000 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:16.127382 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:27:23.427144 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:33.435209 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=18,cinder:UPDATE=6 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:43.097782 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:27:43.153633 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Flow 'volume_create_manager' (64f68555-d40a-4f94-bf12-f35d11e7c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:43.171693 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c0013e-9aa1-46a3-aeb3-16caabdcc48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:43.196255 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c0013e-9aa1-46a3-aeb3-16caabdcc48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1730347921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c751bf64-0b4c-47f3-b45f-c3cb8b41c782,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69b803953acf4ad49e49823a021aff46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:27:43Z,use_quota=True,user_id='93361ffb454d4fb9bccfea7a0e6daf23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:43.217157 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5713771a-3f31-4ada-a9a5-330a77ec3cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:43.221540 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5713771a-3f31-4ada-a9a5-330a77ec3cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:43.244195 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0113c07a-48aa-4d79-b2fd-785f221df037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:43.248345 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0113c07a-48aa-4d79-b2fd-785f221df037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c751bf64-0b4c-47f3-b45f-c3cb8b41c782', 'volume_name': 'volume-c751bf64-0b4c-47f3-b45f-c3cb8b41c782', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:43.272556 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b898cb-3859-4a27-b7c9-6d7d5ea18348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:43.279508 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b898cb-3859-4a27-b7c9-6d7d5ea18348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:43.299453 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2101efa-dc3c-413f-a1ad-2c81910996ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:43.314816 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Volume c751bf64-0b4c-47f3-b45f-c3cb8b41c782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c751bf64-0b4c-47f3-b45f-c3cb8b41c782', 'volume_size': 1} Jul 30 21:27:43.315233 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] creating volume 'volume-c751bf64-0b4c-47f3-b45f-c3cb8b41c782' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:27:43.316304 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:43.457275 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:27:43.457981 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:27:43.462505 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2101efa-dc3c-413f-a1ad-2c81910996ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c751bf64-0b4c-47f3-b45f-c3cb8b41c782', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:43.470911 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5489ebf9-eb31-423e-b845-cd13dbeb0561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:43.487821 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Volume volume-c751bf64-0b4c-47f3-b45f-c3cb8b41c782 (c751bf64-0b4c-47f3-b45f-c3cb8b41c782): created successfully Jul 30 21:27:43.494428 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5489ebf9-eb31-423e-b845-cd13dbeb0561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:43.503971 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Flow 'volume_create_manager' (64f68555-d40a-4f94-bf12-f35d11e7c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:43.522599 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e81cde9e-5e7a-41aa-8136-f355b8758e9e tempest-VolumesTestJSON-202015161 None] Created volume successfully. Jul 30 21:27:45.032852 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:27:45.098612 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Flow 'volume_create_manager' (cfcc786c-2667-4902-a6b0-be03ec244a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:45.127756 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c1adb7-d130-4489-9020-40712fef4629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:45.183107 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c1adb7-d130-4489-9020-40712fef4629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-742610177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=373e4a57-dfc9-405d-bc87-7370130e3525,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69b803953acf4ad49e49823a021aff46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:27:45Z,use_quota=True,user_id='93361ffb454d4fb9bccfea7a0e6daf23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:45.194168 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9158ae-2fa6-4f42-a950-4c6e93536e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:45.199556 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9158ae-2fa6-4f42-a950-4c6e93536e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:45.205310 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847e6060-e314-44a0-a725-bf99de292dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:45.210035 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847e6060-e314-44a0-a725-bf99de292dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '373e4a57-dfc9-405d-bc87-7370130e3525', 'volume_name': 'volume-373e4a57-dfc9-405d-bc87-7370130e3525', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:45.215484 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d9b357-398b-4179-9217-c11455e61be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:45.220759 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d9b357-398b-4179-9217-c11455e61be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:45.225989 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0159dd4d-6612-4ec3-a7c8-97be649d4487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:45.227691 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Volume 373e4a57-dfc9-405d-bc87-7370130e3525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-373e4a57-dfc9-405d-bc87-7370130e3525', 'volume_size': 1} Jul 30 21:27:45.228730 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] creating volume 'volume-373e4a57-dfc9-405d-bc87-7370130e3525' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:27:45.229933 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:45.381841 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:27:45.382212 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:27:45.386560 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0159dd4d-6612-4ec3-a7c8-97be649d4487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373e4a57-dfc9-405d-bc87-7370130e3525', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:45.396433 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a846d6-c92b-43f6-b947-7a5d25639840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:45.424105 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Volume volume-373e4a57-dfc9-405d-bc87-7370130e3525 (373e4a57-dfc9-405d-bc87-7370130e3525): created successfully Jul 30 21:27:45.428324 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a846d6-c92b-43f6-b947-7a5d25639840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:45.434402 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Flow 'volume_create_manager' (cfcc786c-2667-4902-a6b0-be03ec244a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:45.454792 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bef71c87-38a0-4464-845d-f1381636de52 tempest-VolumesTestJSON-202015161 None] Created volume successfully. Jul 30 21:27:46.072390 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e32c8b79-1a08-43ac-9934-cb5ed474e022 tempest-GroupSnapshotsV319Test-586818622 None] Group tempest-GroupSnapshotsV319Test-Group-1840572627: creating Jul 30 21:27:46.115245 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e32c8b79-1a08-43ac-9934-cb5ed474e022 tempest-GroupSnapshotsV319Test-586818622 None] Group tempest-GroupSnapshotsV319Test-Group-1840572627: created successfully Jul 30 21:27:46.144958 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e32c8b79-1a08-43ac-9934-cb5ed474e022 tempest-GroupSnapshotsV319Test-586818622 None] Create group completed successfully. Jul 30 21:27:47.202370 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:27:47.230466 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Flow 'volume_create_manager' (740a14bf-b91a-4a31-9abe-504fe2a3abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:47.250859 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88805a2b-7af5-429c-b50e-1f3bbcb5a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.276472 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88805a2b-7af5-429c-b50e-1f3bbcb5a43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1071458108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2c6698f7-455c-4068-81cb-295a0d620065,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69b803953acf4ad49e49823a021aff46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:27:47Z,use_quota=True,user_id='93361ffb454d4fb9bccfea7a0e6daf23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:47.285084 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76285560-a72b-41e6-b02f-b24a500908d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.291762 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76285560-a72b-41e6-b02f-b24a500908d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:47.305132 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc78514-90be-4862-82aa-527f6de42598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.310814 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc78514-90be-4862-82aa-527f6de42598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6698f7-455c-4068-81cb-295a0d620065', 'volume_name': 'volume-2c6698f7-455c-4068-81cb-295a0d620065', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:47.319740 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340eb339-ceaf-4d9d-973b-5c15310e191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.325972 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340eb339-ceaf-4d9d-973b-5c15310e191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:47.333584 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be8a303-f8b7-4d43-bef5-efa869adf483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.338653 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Volume 2c6698f7-455c-4068-81cb-295a0d620065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6698f7-455c-4068-81cb-295a0d620065', 'volume_size': 1} Jul 30 21:27:47.339253 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] creating volume 'volume-2c6698f7-455c-4068-81cb-295a0d620065' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:27:47.340160 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:47.491835 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:27:47.492326 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:27:47.497405 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be8a303-f8b7-4d43-bef5-efa869adf483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6698f7-455c-4068-81cb-295a0d620065', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:47.521824 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc03842b-9b71-4a33-a9ce-218cd5550473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.555858 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Volume volume-2c6698f7-455c-4068-81cb-295a0d620065 (2c6698f7-455c-4068-81cb-295a0d620065): created successfully Jul 30 21:27:47.561004 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc03842b-9b71-4a33-a9ce-218cd5550473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:47.576300 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Flow 'volume_create_manager' (740a14bf-b91a-4a31-9abe-504fe2a3abb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:47.612372 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-1802a18e-21e6-4e25-b84b-411fb4d79f82 tempest-VolumesTestJSON-202015161 None] Created volume successfully. Jul 30 21:27:47.734240 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:27:47.791880 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Flow 'volume_create_manager' (04f728b2-d8e7-4754-9f00-0028aec9f33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:47.812358 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c626b85-60e4-4fd4-a14d-1e5cf0dda964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.860709 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c626b85-60e4-4fd4-a14d-1e5cf0dda964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-786330143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26e9532f-e462-4725-a5e5-5ec980d5cbab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d885957288749e1b4026f0f426f9588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:27:48Z,use_quota=True,user_id='5387c687bff74fc5a2ad0bd6e2badd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:47.868206 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f17a65-f9b9-4b7f-9ee2-2ea9d6523382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.872552 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f17a65-f9b9-4b7f-9ee2-2ea9d6523382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:47.880066 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9b318f-521e-4ccf-98cb-d5d641aa0130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.894650 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9b318f-521e-4ccf-98cb-d5d641aa0130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e9532f-e462-4725-a5e5-5ec980d5cbab', 'volume_name': 'volume-26e9532f-e462-4725-a5e5-5ec980d5cbab', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:47.920663 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2f0c4a-7271-491a-8715-e6177ede10f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.949219 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2f0c4a-7271-491a-8715-e6177ede10f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:47.972649 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2244c376-fe31-4742-94de-ab1ec702f7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:47.973793 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Volume 26e9532f-e462-4725-a5e5-5ec980d5cbab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e9532f-e462-4725-a5e5-5ec980d5cbab', 'volume_size': 1} Jul 30 21:27:47.974189 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] creating volume 'volume-26e9532f-e462-4725-a5e5-5ec980d5cbab' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:27:47.974850 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:48.177312 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:27:48.189396 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:27:48.194073 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2244c376-fe31-4742-94de-ab1ec702f7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e9532f-e462-4725-a5e5-5ec980d5cbab', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:48.212087 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dfc427-5e49-449a-bf3d-ad5a0f8f6f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:48.248081 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Volume volume-26e9532f-e462-4725-a5e5-5ec980d5cbab (26e9532f-e462-4725-a5e5-5ec980d5cbab): created successfully Jul 30 21:27:48.262089 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dfc427-5e49-449a-bf3d-ad5a0f8f6f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:48.313280 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Flow 'volume_create_manager' (04f728b2-d8e7-4754-9f00-0028aec9f33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:48.325696 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bb2afcd9-5ba3-4236-99f4-fd8ab331576a tempest-VolumeQuotasAdminTestJSON-1033691647 None] Created volume successfully. Jul 30 21:27:48.395645 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:27:48.447653 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Flow 'volume_create_manager' (e061346a-1d87-467d-9f13-4ae00852f65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:48.466830 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c974cd76-19c7-4d47-a087-cd24dd34ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:48.497807 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c974cd76-19c7-4d47-a087-cd24dd34ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-767794725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83beddb4-28f1-4da1-b357-3e419bd5c2ad,host='ncdv-master-1@ceph#ceph',id=75320e31-7068-4e03-a4ff-d3155b67c1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac185b2f86cb4c9aa7702b2bdbe8e0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:27:48Z,use_quota=True,user_id='55e28c2994fe438d91c033e1e92a3077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f836f104-54b8-4899-b653-1517354be200),volume_type_id=f836f104-54b8-4899-b653-1517354be200)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:48.504097 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2ea9d4-2ce9-42b5-abc8-c381f793d8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:48.511832 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2ea9d4-2ce9-42b5-abc8-c381f793d8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:48.525274 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013292e1-2e00-4566-9f6d-a3333974ade3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:48.531843 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013292e1-2e00-4566-9f6d-a3333974ade3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75320e31-7068-4e03-a4ff-d3155b67c1dd', 'volume_name': 'volume-75320e31-7068-4e03-a4ff-d3155b67c1dd', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:48.536924 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480f51cf-1731-46f4-951f-599809471ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:48.553496 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480f51cf-1731-46f4-951f-599809471ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:48.559976 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259ccdf9-c5de-48a6-9430-d945329876d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:48.561122 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Volume 75320e31-7068-4e03-a4ff-d3155b67c1dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75320e31-7068-4e03-a4ff-d3155b67c1dd', 'volume_size': 1} Jul 30 21:27:48.561519 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] creating volume 'volume-75320e31-7068-4e03-a4ff-d3155b67c1dd' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:27:48.562176 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:48.694811 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:27:48.695129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:27:48.699143 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259ccdf9-c5de-48a6-9430-d945329876d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75320e31-7068-4e03-a4ff-d3155b67c1dd', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:48.704196 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a856101-b6e8-4fff-b975-2949c99b5ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:48.742727 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Volume volume-75320e31-7068-4e03-a4ff-d3155b67c1dd (75320e31-7068-4e03-a4ff-d3155b67c1dd): created successfully Jul 30 21:27:48.746542 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a856101-b6e8-4fff-b975-2949c99b5ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:48.753869 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Flow 'volume_create_manager' (e061346a-1d87-467d-9f13-4ae00852f65c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:48.788562 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-7710edc0-3be8-4b01-ada0-18adc7bdb61f tempest-GroupSnapshotsV319Test-586818622 None] Created volume successfully. Jul 30 21:27:48.953231 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] Acquiring lock "cinder-26e9532f-e462-4725-a5e5-5ec980d5cbab-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:27:48.964715 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] Lock "cinder-26e9532f-e462-4725-a5e5-5ec980d5cbab-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:27:49.035113 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:49.136343 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:27:49.136901 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] Volume volume-26e9532f-e462-4725-a5e5-5ec980d5cbab is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:27:49.146447 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] deleting rbd volume volume-26e9532f-e462-4725-a5e5-5ec980d5cbab {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:27:49.674374 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] Created reservations ['55479d2a-3e2f-4842-8f9f-c1e0a10582a2', 'd3c5602f-eded-465f-bace-c97ac7ad1914', '7f7f5622-796c-4281-9598-5018b7aab9dd', 'da371c2c-8600-4685-ae24-d771ab99dc2c'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:27:49.775112 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:49.858108 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:49.963054 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:27:49.969219 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a25e58e7-a817-4543-8c07-dc7bbbefbab4 tempest-GroupSnapshotsV319Test-586818622 None] GroupSnapshot de79f87e-bccc-486e-ba31-12d169570b2c: creating. Jul 30 21:27:50.043132 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] Deleted volume successfully. Jul 30 21:27:50.090802 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a25e58e7-a817-4543-8c07-dc7bbbefbab4 tempest-GroupSnapshotsV319Test-586818622 None] Group snapshot de79f87e-bccc-486e-ba31-12d169570b2c: creating. {{(pid=124008) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}} Jul 30 21:27:50.107409 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6577e593-ceb3-4642-ad0e-e4f376176e6f tempest-VolumeQuotasAdminTestJSON-1033691647 None] Lock "cinder-26e9532f-e462-4725-a5e5-5ec980d5cbab-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:27:50.158014 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a25e58e7-a817-4543-8c07-dc7bbbefbab4 tempest-GroupSnapshotsV319Test-586818622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:50.277771 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] Acquiring lock "cinder-2c6698f7-455c-4068-81cb-295a0d620065-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:27:50.290713 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] Lock "cinder-2c6698f7-455c-4068-81cb-295a0d620065-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:27:50.399212 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:50.530289 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:27:50.530717 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] Volume volume-2c6698f7-455c-4068-81cb-295a0d620065 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:27:50.544530 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] deleting rbd volume volume-2c6698f7-455c-4068-81cb-295a0d620065 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:27:51.018165 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:27:51.041317 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Flow 'volume_create_manager' (778e304d-f961-491b-bc6b-6ff7276e265c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:51.050395 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfdad739-ce00-4187-aa71-64c6a4800b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:51.102628 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfdad739-ce00-4187-aa71-64c6a4800b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2016680072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=215851e4-b237-4d8a-a354-128e04ad3847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d885957288749e1b4026f0f426f9588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:27:51Z,use_quota=True,user_id='5387c687bff74fc5a2ad0bd6e2badd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:51.121355 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43342118-9511-4e1a-9c67-210a7301992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:51.127622 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43342118-9511-4e1a-9c67-210a7301992d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:51.148357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0bfa64-5273-478d-9f97-3541fe7b9715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:51.153925 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0bfa64-5273-478d-9f97-3541fe7b9715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215851e4-b237-4d8a-a354-128e04ad3847', 'volume_name': 'volume-215851e4-b237-4d8a-a354-128e04ad3847', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:51.162409 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60854884-20ab-4f4e-bae7-f84cb7fc3ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:51.169082 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60854884-20ab-4f4e-bae7-f84cb7fc3ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:51.188793 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f82e0d9-58f5-48a4-a40c-2fbd818cb774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:51.190363 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Volume 215851e4-b237-4d8a-a354-128e04ad3847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215851e4-b237-4d8a-a354-128e04ad3847', 'volume_size': 1} Jul 30 21:27:51.193457 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] creating volume 'volume-215851e4-b237-4d8a-a354-128e04ad3847' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:27:51.194450 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:51.299810 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] Created reservations ['59d4375f-c5b5-4131-8293-5c5270626a5d', '70335201-edd6-4df6-a57a-c2d472135d8a', 'fac6e608-a56f-4584-9754-ac1013511944', '7880bed4-8128-4278-a95a-57ea28aada17'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:27:51.359397 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:27:51.360869 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:27:51.364583 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f82e0d9-58f5-48a4-a40c-2fbd818cb774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215851e4-b237-4d8a-a354-128e04ad3847', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:51.369193 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ec9968-09bf-481f-a125-2ff15b7b72f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:27:51.428347 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Volume volume-215851e4-b237-4d8a-a354-128e04ad3847 (215851e4-b237-4d8a-a354-128e04ad3847): created successfully Jul 30 21:27:51.432179 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ec9968-09bf-481f-a125-2ff15b7b72f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:27:51.438367 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Flow 'volume_create_manager' (778e304d-f961-491b-bc6b-6ff7276e265c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:27:51.467050 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-64ffbefe-b04c-4a8c-b22d-c4854cf73905 tempest-VolumeQuotasAdminTestJSON-1033691647 None] Created volume successfully. Jul 30 21:27:51.502142 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=60,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:51.537543 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:51.593258 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:51.666748 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:27:51.672425 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] Deleted volume successfully. Jul 30 21:27:51.687795 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=67,cinder:UPDATE=22,cinder:DELETE=4,cinder:INSERT=7 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:51.694823 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a25e58e7-a817-4543-8c07-dc7bbbefbab4 tempest-GroupSnapshotsV319Test-586818622 None] group_snapshot de79f87e-bccc-486e-ba31-12d169570b2c: created successfully Jul 30 21:27:51.708603 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-231561b5-7ad5-43f7-8935-c528370bb42e tempest-VolumesTestJSON-202015161 None] Lock "cinder-2c6698f7-455c-4068-81cb-295a0d620065-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:27:52.713650 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] Acquiring lock "cinder-373e4a57-dfc9-405d-bc87-7370130e3525-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:27:52.727784 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] Lock "cinder-373e4a57-dfc9-405d-bc87-7370130e3525-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:27:52.853373 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:52.960907 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:27:52.961343 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] Volume volume-373e4a57-dfc9-405d-bc87-7370130e3525 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:27:52.973976 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] deleting rbd volume volume-373e4a57-dfc9-405d-bc87-7370130e3525 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:27:53.103766 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2ec8f7f8-40a7-49a2-91d1-a9b73ad958ba tempest-VolumeQuotasAdminTestJSON-239745964 None] Transfer volume completed successfully. Jul 30 21:27:53.146962 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c4b3f485-9d39-4a27-9f39-3fcb6f7a7d53 tempest-GroupSnapshotsV319Test-586818622 None] group_snapshot de79f87e-bccc-486e-ba31-12d169570b2c: deleting Jul 30 21:27:53.197158 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c4b3f485-9d39-4a27-9f39-3fcb6f7a7d53 tempest-GroupSnapshotsV319Test-586818622 None] group_snapshot de79f87e-bccc-486e-ba31-12d169570b2c: deleting {{(pid=124008) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}} Jul 30 21:27:53.253757 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c4b3f485-9d39-4a27-9f39-3fcb6f7a7d53 tempest-GroupSnapshotsV319Test-586818622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:53.454754 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] Created reservations ['3598473e-c626-410b-8e00-de0a35b30061', '9d57bebc-37e3-472a-ad82-f65912f9b5b6', 'c8d7095d-7dd6-491a-b50d-4f43b607d50e', '5cd8b89a-67c9-43c5-9f15-a57625990c57'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:27:53.584550 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:53.652125 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:53.716640 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:27:53.721312 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] Deleted volume successfully. Jul 30 21:27:53.757011 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-f4290c17-0501-4c0f-afe0-c0ed3997fdd6 tempest-VolumesTestJSON-202015161 None] Lock "cinder-373e4a57-dfc9-405d-bc87-7370130e3525-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:27:53.889846 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] Acquiring lock "cinder-215851e4-b237-4d8a-a354-128e04ad3847-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:27:53.909033 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] Lock "cinder-215851e4-b237-4d8a-a354-128e04ad3847-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:27:53.984640 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:54.082041 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:27:54.082466 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] Volume volume-215851e4-b237-4d8a-a354-128e04ad3847 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:27:54.088360 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] deleting rbd volume volume-215851e4-b237-4d8a-a354-128e04ad3847 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:27:54.106868 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] Acquiring lock "cinder-c751bf64-0b4c-47f3-b45f-c3cb8b41c782-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:27:54.130208 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] Lock "cinder-c751bf64-0b4c-47f3-b45f-c3cb8b41c782-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:27:54.195911 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:54.295137 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:27:54.295994 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] Volume volume-c751bf64-0b4c-47f3-b45f-c3cb8b41c782 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:27:54.306551 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] deleting rbd volume volume-c751bf64-0b4c-47f3-b45f-c3cb8b41c782 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:27:54.492035 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-c4b3f485-9d39-4a27-9f39-3fcb6f7a7d53 tempest-GroupSnapshotsV319Test-586818622 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-476942854 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-476942854, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:27:54.493011 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-c4b3f485-9d39-4a27-9f39-3fcb6f7a7d53 tempest-GroupSnapshotsV319Test-586818622 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-476942854 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-476942854, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:27:54.526260 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-c4b3f485-9d39-4a27-9f39-3fcb6f7a7d53 tempest-GroupSnapshotsV319Test-586818622 None] Created reservations ['f8cb2a4f-df7d-4a38-8a9f-e60f9c010319', 'd97cd12a-d2fd-45d6-8247-6ea14b059b19', '99e8f10f-bc47-4ebc-8e54-08f400bea156', '42da9352-14da-43e5-8fbb-7856e385287d'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:27:54.700064 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c4b3f485-9d39-4a27-9f39-3fcb6f7a7d53 tempest-GroupSnapshotsV319Test-586818622 None] group_snapshot de79f87e-bccc-486e-ba31-12d169570b2c: deleted successfully Jul 30 21:27:54.704436 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] Created reservations ['5e9d42aa-6773-4d98-af47-420dcf3df6d7', '89237166-a30f-4556-8fc2-2d110c2e3cac', '68c546ed-404c-4e64-8e3f-ee690f4a0949', '6bbb6e48-fac1-49c0-bfd2-976927b0906d'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:27:54.866056 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:54.944116 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:55.087686 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:27:55.103040 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] Deleted volume successfully. Jul 30 21:27:55.139562 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c3ad1518-d141-4bd4-861d-2d6457fad581 tempest-VolumeQuotasAdminTestJSON-2053357029 None] Lock "cinder-215851e4-b237-4d8a-a354-128e04ad3847-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:27:55.187343 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] Created reservations ['7b5a4f45-97ef-43cd-98e6-3b2108ccafa4', '7f3320e8-adb4-48b1-8061-56660bdff229', '74c698d9-8fee-4ecc-95fd-4c498df05c36', '91951c4e-a946-4c28-b228-8ea90233b8f5'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:27:55.228303 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=55,cinder:UPDATE=31,cinder:INSERT=13,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:55.306410 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:55.354611 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:55.413862 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:27:55.421128 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] Deleted volume successfully. Jul 30 21:27:55.449144 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c71c1b40-acf3-40f7-ad45-11e26f222d57 tempest-VolumesTestJSON-202015161 None] Lock "cinder-c751bf64-0b4c-47f3-b45f-c3cb8b41c782-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:27:56.306123 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:56.453722 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:27:56.454073 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] Volume volume-75320e31-7068-4e03-a4ff-d3155b67c1dd is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:27:56.467374 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] deleting rbd volume volume-75320e31-7068-4e03-a4ff-d3155b67c1dd {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:27:56.987536 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] Created reservations ['b1fd02cb-27ca-468e-bb05-8cec1acd9c43'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:27:57.040640 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-476942854 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-476942854, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:27:57.076100 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=60,cinder:INSERT=6,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:27:57.092118 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] Created reservations ['0850aaf0-f878-46d3-8598-fef00639c843', 'c3a708d9-b55c-4f32-b180-7baadf1ecb08', 'babc5280-4470-4365-962c-6b553e7937e4', '835b9a20-750b-4c4a-b0d2-6d9b6a247a33'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:27:57.287241 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:57.352818 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:27:57.430369 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:27:57.434285 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-eea37704-2eb5-48df-b5de-376515dbf7a6 tempest-GroupSnapshotsV319Test-586818622 None] Delete group completed successfully. Jul 30 21:28:07.583588 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c8c92e0a-639e-44a5-a614-374f921200e3 tempest-GroupsV314Test-2023915098 None] Group tempest-GroupsV314Test-Group-456062246: creating Jul 30 21:28:07.628859 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c8c92e0a-639e-44a5-a614-374f921200e3 tempest-GroupsV314Test-2023915098 None] Group tempest-GroupsV314Test-Group-456062246: created successfully Jul 30 21:28:07.648678 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c8c92e0a-639e-44a5-a614-374f921200e3 tempest-GroupsV314Test-2023915098 None] Create group completed successfully. Jul 30 21:28:09.588943 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:09.622465 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Flow 'volume_create_manager' (54d2d399-a605-4f93-846c-401b00c6d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:09.641725 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d39992-b0bb-4693-800a-726380dd300a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:09.684526 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d39992-b0bb-4693-800a-726380dd300a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1366980445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d83345d-e1aa-45f4-9033-375d1e0c2e79,host='ncdv-master-1@ceph#ceph',id=29e8c228-6c2b-46fc-af17-e3babc74e4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d48ba124cd4fa0b42cdaaa91ded769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:09Z,use_quota=True,user_id='b7aa09bea7b64b4aac2ca6576d210616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75f5c60e-2095-4c9e-a1de-6cec7f843c38),volume_type_id=75f5c60e-2095-4c9e-a1de-6cec7f843c38)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:09.694673 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b0281b-7601-4170-a6e6-3cd669a5969b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:09.700367 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b0281b-7601-4170-a6e6-3cd669a5969b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:09.707206 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2381225-668c-4f89-88c9-cebb068899a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:09.714355 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2381225-668c-4f89-88c9-cebb068899a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e8c228-6c2b-46fc-af17-e3babc74e4aa', 'volume_name': 'volume-29e8c228-6c2b-46fc-af17-e3babc74e4aa', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:09.721155 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267912e4-b23a-4453-982e-3fec6163ffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:09.726364 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267912e4-b23a-4453-982e-3fec6163ffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:09.734877 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6235f99f-ad9a-4633-a14f-26b014f41911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:09.736765 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Volume 29e8c228-6c2b-46fc-af17-e3babc74e4aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e8c228-6c2b-46fc-af17-e3babc74e4aa', 'volume_size': 1} Jul 30 21:28:09.737362 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] creating volume 'volume-29e8c228-6c2b-46fc-af17-e3babc74e4aa' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:09.738305 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:09.861294 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:09.863350 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:09.871813 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6235f99f-ad9a-4633-a14f-26b014f41911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e8c228-6c2b-46fc-af17-e3babc74e4aa', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:09.891766 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f509ac-ae67-4bb9-90e1-6f6b834fe7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:09.915081 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Volume volume-29e8c228-6c2b-46fc-af17-e3babc74e4aa (29e8c228-6c2b-46fc-af17-e3babc74e4aa): created successfully Jul 30 21:28:09.920618 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f509ac-ae67-4bb9-90e1-6f6b834fe7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:09.926865 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Flow 'volume_create_manager' (54d2d399-a605-4f93-846c-401b00c6d42c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:09.944690 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-9abf2483-f2f0-473f-b972-5d6eb340dafd tempest-GroupsV314Test-2023915098 None] Created volume successfully. Jul 30 21:28:12.068723 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4b07054c-fde3-4ba0-8bbc-f33f25fc3891 tempest-GroupsV314Test-2023915098 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:12.217303 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4b07054c-fde3-4ba0-8bbc-f33f25fc3891 tempest-GroupsV314Test-2023915098 None] creating snapshot='volume-a0460955-8ec2-470f-a735-93620e684cb0.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:28:12.650948 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4b07054c-fde3-4ba0-8bbc-f33f25fc3891 tempest-GroupsV314Test-2023915098 None] cloning 'volume-29e8c228-6c2b-46fc-af17-e3babc74e4aa@volume-a0460955-8ec2-470f-a735-93620e684cb0.clone_snap' to 'volume-a0460955-8ec2-470f-a735-93620e684cb0' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:28:12.816986 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4b07054c-fde3-4ba0-8bbc-f33f25fc3891 tempest-GroupsV314Test-2023915098 None] Volume volume-29e8c228-6c2b-46fc-af17-e3babc74e4aa is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:12.828603 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4b07054c-fde3-4ba0-8bbc-f33f25fc3891 tempest-GroupsV314Test-2023915098 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:12.829349 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4b07054c-fde3-4ba0-8bbc-f33f25fc3891 tempest-GroupsV314Test-2023915098 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:12.878675 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4b07054c-fde3-4ba0-8bbc-f33f25fc3891 tempest-GroupsV314Test-2023915098 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:28:13.051958 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-4b07054c-fde3-4ba0-8bbc-f33f25fc3891 tempest-GroupsV314Test-2023915098 None] Create group from source-group-1d83345d-e1aa-45f4-9033-375d1e0c2e79 completed successfully. Jul 30 21:28:13.997985 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:14.111667 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:14.132581 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] deleting rbd volume volume-a0460955-8ec2-470f-a735-93620e684cb0 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:14.457108 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:28:14.487866 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] Volume volume-29e8c228-6c2b-46fc-af17-e3babc74e4aa is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:14.488381 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] deleting parent snapshot volume-a0460955-8ec2-470f-a735-93620e684cb0.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:28:14.798614 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] Created reservations ['e2569144-d3cc-46d4-b8a0-4a8e6f5e99c9'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:14.820869 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-755039745 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-755039745, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:28:14.822081 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-755039745 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-755039745, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:28:14.849720 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] Created reservations ['b8263c35-598e-403d-810c-7f66d17652b7', '839606ce-2754-4ac2-89b3-d07754365e9d', '4c756ba2-eb32-4499-96a6-af7e7b55a125', 'd90b5d1d-9f41-414b-ae96-c62895f14130'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:14.939730 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=63,cinder:DELETE=1,cinder:INSERT=7,cinder:UPDATE=29 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:14.962671 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:15.041460 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:15.153532 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:15.162065 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2a38cfe6-ccc1-456f-ba76-fc7d96d00a2b tempest-GroupsV314Test-2023915098 None] Delete group completed successfully. Jul 30 21:28:15.554092 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e42ad81a-a0fc-418a-88f2-961e49842880 tempest-GroupsV314Test-2023915098 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:15.657923 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e42ad81a-a0fc-418a-88f2-961e49842880 tempest-GroupsV314Test-2023915098 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:15.658449 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e42ad81a-a0fc-418a-88f2-961e49842880 tempest-GroupsV314Test-2023915098 None] Volume volume-29e8c228-6c2b-46fc-af17-e3babc74e4aa is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:15.664444 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e42ad81a-a0fc-418a-88f2-961e49842880 tempest-GroupsV314Test-2023915098 None] deleting rbd volume volume-29e8c228-6c2b-46fc-af17-e3babc74e4aa {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:15.977138 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:28:15.978762 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:16.059836 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:16.133348 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:16.180990 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-e42ad81a-a0fc-418a-88f2-961e49842880 tempest-GroupsV314Test-2023915098 None] Created reservations ['2b66037c-f80e-4dbe-b98d-bd04ced95fd7'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:16.248914 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-e42ad81a-a0fc-418a-88f2-961e49842880 tempest-GroupsV314Test-2023915098 None] Created reservations ['620c40b2-4154-4d81-9fec-8aa89b255d89', 'a39023c6-b75f-4e4a-ad96-edfeb75a8dd1', 'ca43f9f5-86da-4596-a368-e404bbcb5144', '3dcbd89b-2c6c-4e61-b9aa-c04a5d6630bd'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:16.347098 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e42ad81a-a0fc-418a-88f2-961e49842880 tempest-GroupsV314Test-2023915098 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:16.395141 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e42ad81a-a0fc-418a-88f2-961e49842880 tempest-GroupsV314Test-2023915098 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:16.456813 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-e42ad81a-a0fc-418a-88f2-961e49842880 tempest-GroupsV314Test-2023915098 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:16.461276 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e42ad81a-a0fc-418a-88f2-961e49842880 tempest-GroupsV314Test-2023915098 None] Delete group completed successfully. Jul 30 21:28:23.437080 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=63,cinder:UPDATE=33,cinder:DELETE=1,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:24.841006 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:24.868727 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Flow 'volume_create_manager' (b1193c0f-d8e3-4fd6-9053-96f5eac6a074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:24.877607 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6604e7d-d6f3-4136-a9f5-f769c38ce0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:24.896517 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6604e7d-d6f3-4136-a9f5-f769c38ce0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-580353957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fdd78e72-c788-4f21-a4f5-46d24e331fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b37395154b44e35a734b230f66b61cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:25Z,use_quota=True,user_id='9934b91efbbe46da9ac86ecf5504e5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df1fe2c7-0b52-4994-9460-ec9c2a58687c),volume_type_id=df1fe2c7-0b52-4994-9460-ec9c2a58687c)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:24.903422 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d360fede-a87b-4d24-addc-d52be3a90d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:24.908833 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d360fede-a87b-4d24-addc-d52be3a90d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:24.916152 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a615c1e0-418d-44e8-b39f-4814e2343077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:24.923649 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a615c1e0-418d-44e8-b39f-4814e2343077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd78e72-c788-4f21-a4f5-46d24e331fad', 'volume_name': 'volume-fdd78e72-c788-4f21-a4f5-46d24e331fad', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:24.929374 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9178a752-ccf1-479a-a382-5cb8f11523ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:24.934411 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9178a752-ccf1-479a-a382-5cb8f11523ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:24.940514 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc3ec66-9fce-4d9d-8d2e-900b78ba6d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:24.941869 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Volume fdd78e72-c788-4f21-a4f5-46d24e331fad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd78e72-c788-4f21-a4f5-46d24e331fad', 'volume_size': 1} Jul 30 21:28:24.942517 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] creating volume 'volume-fdd78e72-c788-4f21-a4f5-46d24e331fad' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:24.943691 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:25.056422 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:25.056801 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:25.062173 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc3ec66-9fce-4d9d-8d2e-900b78ba6d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd78e72-c788-4f21-a4f5-46d24e331fad', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:25.068429 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65e82c9-b939-4628-b7ea-e7edfea02eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:25.094803 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Volume volume-fdd78e72-c788-4f21-a4f5-46d24e331fad (fdd78e72-c788-4f21-a4f5-46d24e331fad): created successfully Jul 30 21:28:25.101958 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65e82c9-b939-4628-b7ea-e7edfea02eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:25.111528 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Flow 'volume_create_manager' (b1193c0f-d8e3-4fd6-9053-96f5eac6a074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:25.152088 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-4eb6454d-ce14-4262-a7bc-a2c0cebf5f13 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Created volume successfully. Jul 30 21:28:26.470898 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-251c4476-4349-456d-bba4-83c604022b70 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:26.542684 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-251c4476-4349-456d-bba4-83c604022b70 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:26.575213 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-251c4476-4349-456d-bba4-83c604022b70 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:26.583542 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-251c4476-4349-456d-bba4-83c604022b70 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Retype volume completed successfully. Jul 30 21:28:27.806999 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Acquiring lock "cinder-fdd78e72-c788-4f21-a4f5-46d24e331fad-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:27.827545 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Lock "cinder-fdd78e72-c788-4f21-a4f5-46d24e331fad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:27.918177 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:28.017006 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:28.017919 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Volume volume-fdd78e72-c788-4f21-a4f5-46d24e331fad is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:28.026667 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] deleting rbd volume volume-fdd78e72-c788-4f21-a4f5-46d24e331fad {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:28.348188 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:28:28.348973 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:28:28.396456 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Created reservations ['7d64d45c-882d-4e36-b0b3-d549122b94ae', '9fef8435-474c-47e4-bebd-27e28367c694', '76f21b66-eaab-4bbc-8b52-82da71fc060d', 'b6efc681-213b-4fdd-a7d7-bf2f15ab908b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:28.487553 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:28.544114 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:28.611833 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:28.630692 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Deleted volume successfully. Jul 30 21:28:28.649761 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ea28fd76-2114-4299-8ed7-e48ae3d042b7 tempest-VolumeRetypeWithoutMigrationTest-44585214 None] Lock "cinder-fdd78e72-c788-4f21-a4f5-46d24e331fad-delete_volume" released by "delete_volume" :: held 0.822s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:30.487849 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8cdd3da8-aaa0-420f-a5ab-624ada0fbf61 tempest-GroupsTest-405631875 None] Group tempest-Group1-275097586: creating Jul 30 21:28:30.513423 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8cdd3da8-aaa0-420f-a5ab-624ada0fbf61 tempest-GroupsTest-405631875 None] Group tempest-Group1-275097586: created successfully Jul 30 21:28:30.526309 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8cdd3da8-aaa0-420f-a5ab-624ada0fbf61 tempest-GroupsTest-405631875 None] Create group completed successfully. Jul 30 21:28:31.863190 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f2f102ee-1069-455e-b41b-4f41358f7bbc tempest-GroupsTest-405631875 None] Group tempest-Group2-1401804513: creating Jul 30 21:28:31.907613 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f2f102ee-1069-455e-b41b-4f41358f7bbc tempest-GroupsTest-405631875 None] Group tempest-Group2-1401804513: created successfully Jul 30 21:28:31.919611 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f2f102ee-1069-455e-b41b-4f41358f7bbc tempest-GroupsTest-405631875 None] Create group completed successfully. Jul 30 21:28:33.760080 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:33.825056 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Flow 'volume_create_manager' (9d4ec349-d40b-4c84-a2eb-e23472f8a162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:33.840416 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81317f7b-394d-4d70-b37e-d3846ca417fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:33.909340 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81317f7b-394d-4d70-b37e-d3846ca417fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1658733154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=377094b3-3893-41a7-a72d-b547d5d91649,host='ncdv-master-1@ceph#ceph',id=1a7e47d6-d1e0-497b-9771-b84bd40699be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2dc8f7f209747caa4acb5ca89b4ed99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:34Z,use_quota=True,user_id='04891d42f10d43e9b95e14ad8b5c67c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0c812d-b0d8-489e-ba63-99e6fcf9075c),volume_type_id=0c0c812d-b0d8-489e-ba63-99e6fcf9075c)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:33.926844 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781d9b7a-96de-4ba2-80f3-0908b60048b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:33.941430 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781d9b7a-96de-4ba2-80f3-0908b60048b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:33.992550 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27b059a-ed3a-4418-ba53-55f725a20cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:34.007750 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27b059a-ed3a-4418-ba53-55f725a20cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a7e47d6-d1e0-497b-9771-b84bd40699be', 'volume_name': 'volume-1a7e47d6-d1e0-497b-9771-b84bd40699be', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:34.023801 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107041c8-f7b7-4a4d-8cd0-98d65e340e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:34.036949 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107041c8-f7b7-4a4d-8cd0-98d65e340e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:34.047637 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aae2f1-a1d9-4999-9423-01aef491edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:34.051714 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Volume 1a7e47d6-d1e0-497b-9771-b84bd40699be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a7e47d6-d1e0-497b-9771-b84bd40699be', 'volume_size': 1} Jul 30 21:28:34.054109 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] creating volume 'volume-1a7e47d6-d1e0-497b-9771-b84bd40699be' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:34.055095 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:34.190696 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:34.191217 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:34.196119 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aae2f1-a1d9-4999-9423-01aef491edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7e47d6-d1e0-497b-9771-b84bd40699be', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:34.205186 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b997a4da-8d06-4b4d-8309-ebe96842d4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:34.225440 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Volume volume-1a7e47d6-d1e0-497b-9771-b84bd40699be (1a7e47d6-d1e0-497b-9771-b84bd40699be): created successfully Jul 30 21:28:34.235906 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b997a4da-8d06-4b4d-8309-ebe96842d4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:34.248890 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Flow 'volume_create_manager' (9d4ec349-d40b-4c84-a2eb-e23472f8a162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:34.273851 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-ecaf3ff1-513c-49e8-912f-4e4406865a31 tempest-GroupsTest-405631875 None] Created volume successfully. Jul 30 21:28:35.577154 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:35.656478 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:35.656778 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] Volume volume-1a7e47d6-d1e0-497b-9771-b84bd40699be is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:35.667605 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] deleting rbd volume volume-1a7e47d6-d1e0-497b-9771-b84bd40699be {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:36.127743 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=63,cinder:UPDATE=31,cinder:INSERT=4,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:36.182997 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] Created reservations ['152ef5ab-e110-4363-893e-788ec3fe9605'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:36.250580 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-281790319 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-281790319, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:28:36.256460 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-281790319 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-281790319, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:28:36.311411 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] Created reservations ['21d0e15b-8e71-4c9b-a3ee-5025d022cde1', 'aba7d49c-d23c-4bd5-8287-9a1f2449e515', 'eccb0f55-a7b4-445e-8139-8b00bc5bbcb2', '3db16a78-d349-4c70-b95c-bbc56339eb85'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:36.531167 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:36.666357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:36.769042 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:36.774227 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8d7847ae-3f16-478f-a373-fccf84eea716 tempest-GroupsTest-405631875 None] Delete group completed successfully. Jul 30 21:28:36.952843 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:37.045822 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Flow 'volume_create_manager' (6226d5f4-938a-41f0-b73f-02821bbce288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:37.071818 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14dc7c5-835f-4e8d-b585-b6d5689009ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.097211 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=69,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:37.151324 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14dc7c5-835f-4e8d-b585-b6d5689009ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-157368497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e6b5d1c2-3bde-401c-9f14-8d23cd3fd891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89085b5a4bd54636966a2c9e1a2a4ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:37Z,use_quota=True,user_id='54a4d2bd69f449288b49186d9f06d75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b207484e-5e18-424a-bbd3-3c9c5541d51c),volume_type_id=b207484e-5e18-424a-bbd3-3c9c5541d51c)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:37.167725 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1889c8f-0a92-43cb-b099-c017a5782c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.176586 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1889c8f-0a92-43cb-b099-c017a5782c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:37.192629 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b798bc8e-406e-425c-9354-e13aee2cc0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.205339 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b798bc8e-406e-425c-9354-e13aee2cc0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6b5d1c2-3bde-401c-9f14-8d23cd3fd891', 'volume_name': 'volume-e6b5d1c2-3bde-401c-9f14-8d23cd3fd891', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:37.218792 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3c41a5-8a41-4a6a-8ede-3f2e75dd6436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.229006 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3c41a5-8a41-4a6a-8ede-3f2e75dd6436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:37.240087 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0102d16-9610-4df9-91c2-2c8d85422e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.243417 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Volume e6b5d1c2-3bde-401c-9f14-8d23cd3fd891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6b5d1c2-3bde-401c-9f14-8d23cd3fd891', 'volume_size': 1} Jul 30 21:28:37.244129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] creating volume 'volume-e6b5d1c2-3bde-401c-9f14-8d23cd3fd891' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:37.245692 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:37.421952 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:37.423161 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:37.427310 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0102d16-9610-4df9-91c2-2c8d85422e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b5d1c2-3bde-401c-9f14-8d23cd3fd891', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:37.433836 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb773ad-5883-4064-86ca-1d76e6f92973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.464106 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Volume volume-e6b5d1c2-3bde-401c-9f14-8d23cd3fd891 (e6b5d1c2-3bde-401c-9f14-8d23cd3fd891): created successfully Jul 30 21:28:37.470527 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb773ad-5883-4064-86ca-1d76e6f92973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:37.496868 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Flow 'volume_create_manager' (6226d5f4-938a-41f0-b73f-02821bbce288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:37.518911 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-ea075e10-b10d-448c-b6b9-be0fb11bee54 tempest-GroupsTest-405631875 None] Created reservations ['2a91112a-89ad-47a9-9787-1581aa311360'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:37.538693 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e29975b7-281c-4bf8-9ad2-8564f69d8fe9 tempest-VolumeTypesTest-1214572047 None] Created volume successfully. Jul 30 21:28:37.594440 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea075e10-b10d-448c-b6b9-be0fb11bee54 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:37.674073 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ea075e10-b10d-448c-b6b9-be0fb11bee54 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:37.738222 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-ea075e10-b10d-448c-b6b9-be0fb11bee54 tempest-GroupsTest-405631875 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:37.786190 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-ea075e10-b10d-448c-b6b9-be0fb11bee54 tempest-GroupsTest-405631875 None] Delete group completed successfully. Jul 30 21:28:37.804772 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:37.834610 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (86367f49-9277-4428-8481-cc5640ed8ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:37.852330 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce39dd3-56ae-44c3-ace8-5effcc22d0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.902573 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce39dd3-56ae-44c3-ace8-5effcc22d0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1031412487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=67271f6c-0fba-4790-954f-ba1f022aa2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418ff359f7a747e58ae4fdf0c4b7072a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:38Z,use_quota=True,user_id='db01f9802e8147b8bdabfc9bbbbd7bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:37.908618 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81df4c5-3f27-41cc-900c-e5aa806598b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.912732 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81df4c5-3f27-41cc-900c-e5aa806598b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:37.918441 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a104532-e957-49b8-8529-bf8247b0ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.923030 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a104532-e957-49b8-8529-bf8247b0ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67271f6c-0fba-4790-954f-ba1f022aa2aa', 'volume_name': 'volume-67271f6c-0fba-4790-954f-ba1f022aa2aa', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:37.928408 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2c6aeb-851f-4a7f-b889-92c372c38cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.943062 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2c6aeb-851f-4a7f-b889-92c372c38cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:37.953146 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644046e2-7e1b-4352-bd63-4d64afaa1b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:37.957180 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Volume 67271f6c-0fba-4790-954f-ba1f022aa2aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67271f6c-0fba-4790-954f-ba1f022aa2aa', 'volume_size': 1} Jul 30 21:28:37.957180 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] creating volume 'volume-67271f6c-0fba-4790-954f-ba1f022aa2aa' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:37.957180 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:38.093939 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:38.094428 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:38.098590 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644046e2-7e1b-4352-bd63-4d64afaa1b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67271f6c-0fba-4790-954f-ba1f022aa2aa', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:38.110702 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800b13ae-6c68-4cb6-8c46-5eb19a6bcf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:38.147725 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Volume volume-67271f6c-0fba-4790-954f-ba1f022aa2aa (67271f6c-0fba-4790-954f-ba1f022aa2aa): created successfully Jul 30 21:28:38.152394 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800b13ae-6c68-4cb6-8c46-5eb19a6bcf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:38.173361 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (86367f49-9277-4428-8481-cc5640ed8ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:38.200426 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2d8afbde-f61d-4446-b5b2-660bd27647dc tempest-VolumesActionsTest-1856691178 None] Created volume successfully. Jul 30 21:28:38.637447 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b1d0778e-5254-45a9-9438-68c2d597c89b tempest-VolumeTypesTest-1214572047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:38.674815 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b1d0778e-5254-45a9-9438-68c2d597c89b tempest-VolumeTypesTest-1214572047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:38.777053 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-b1d0778e-5254-45a9-9438-68c2d597c89b tempest-VolumeTypesTest-1214572047 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:38.784076 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0d9a935c-2b2f-44ad-a58a-a0fb196f9f9b tempest-VolumesActionsTest-1856691178 None] Acquiring lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa" by "attach_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:38.814798 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b1d0778e-5254-45a9-9438-68c2d597c89b tempest-VolumeTypesTest-1214572047 None] Retype volume completed successfully. Jul 30 21:28:38.831820 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0d9a935c-2b2f-44ad-a58a-a0fb196f9f9b tempest-VolumesActionsTest-1856691178 None] Lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa" acquired by "attach_volume" :: waited 0.048s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:38.957066 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0d9a935c-2b2f-44ad-a58a-a0fb196f9f9b tempest-VolumesActionsTest-1856691178 None] Attaching volume 67271f6c-0fba-4790-954f-ba1f022aa2aa to instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7 at mountpoint /dev/sdb on host None. Jul 30 21:28:39.026588 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0d9a935c-2b2f-44ad-a58a-a0fb196f9f9b tempest-VolumesActionsTest-1856691178 None] Attach volume completed successfully. Jul 30 21:28:39.032684 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0d9a935c-2b2f-44ad-a58a-a0fb196f9f9b tempest-VolumesActionsTest-1856691178 None] Lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa" released by "attach_volume" :: held 0.201s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:39.238034 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-97db3e8e-dad1-4f05-b411-ebe1bd052b15 tempest-GroupsTest-405631875 None] Group tempest-GroupsTest-Group-1701930762: creating Jul 30 21:28:39.283825 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-97db3e8e-dad1-4f05-b411-ebe1bd052b15 tempest-GroupsTest-405631875 None] Group tempest-GroupsTest-Group-1701930762: created successfully Jul 30 21:28:39.307014 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-97db3e8e-dad1-4f05-b411-ebe1bd052b15 tempest-GroupsTest-405631875 None] Create group completed successfully. Jul 30 21:28:39.834055 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-fd82dad0-9bc5-4235-9ff9-66d35280d206 tempest-VolumesActionsTest-1888943910 None] Terminate volume connection completed successfully. Jul 30 21:28:39.869551 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fd82dad0-9bc5-4235-9ff9-66d35280d206 tempest-VolumesActionsTest-1888943910 None] Acquiring lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa-detach_volume" by "detach_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:39.894031 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fd82dad0-9bc5-4235-9ff9-66d35280d206 tempest-VolumesActionsTest-1888943910 None] Lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:39.914615 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-fd82dad0-9bc5-4235-9ff9-66d35280d206 tempest-VolumesActionsTest-1888943910 None] Detaching volume 67271f6c-0fba-4790-954f-ba1f022aa2aa from instance d42ff5b5-402f-4eba-ba75-6fe636f6aaf7. Jul 30 21:28:39.995019 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-fd82dad0-9bc5-4235-9ff9-66d35280d206 tempest-VolumesActionsTest-1888943910 None] Detach volume completed successfully. Jul 30 21:28:40.013305 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fd82dad0-9bc5-4235-9ff9-66d35280d206 tempest-VolumesActionsTest-1888943910 None] Lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:40.266569 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-04c22266-8c56-4b7a-be2e-9534e171962a tempest-VolumesActionsTest-1856691178 None] Acquiring lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa-detach_volume" by "detach_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:40.286342 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-04c22266-8c56-4b7a-be2e-9534e171962a tempest-VolumesActionsTest-1856691178 None] Lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:40.287016 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-04c22266-8c56-4b7a-be2e-9534e171962a tempest-VolumesActionsTest-1856691178 None] Volume detach called, but volume not attached. Jul 30 21:28:40.300537 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-04c22266-8c56-4b7a-be2e-9534e171962a tempest-VolumesActionsTest-1856691178 None] Lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa-detach_volume" released by "detach_volume" :: held 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:41.748807 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] Acquiring lock "cinder-e6b5d1c2-3bde-401c-9f14-8d23cd3fd891-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:41.764500 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:41.806972 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Flow 'volume_create_manager' (18f6f535-26d3-4821-a169-8683f0f6bf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:41.828369 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88e53df-bce6-4754-bc34-c3fa66868d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:41.838318 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=65,cinder:INSERT=4,cinder:UPDATE=31 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:41.853345 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] Lock "cinder-e6b5d1c2-3bde-401c-9f14-8d23cd3fd891-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:41.865574 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88e53df-bce6-4754-bc34-c3fa66868d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1098148059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ad5585a-6089-43a9-855d-2b4f301f4070,host='ncdv-master-1@ceph#ceph',id=6bb0d286-209c-4e09-b87b-c99c2ce1fc04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2dc8f7f209747caa4acb5ca89b4ed99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:42Z,use_quota=True,user_id='04891d42f10d43e9b95e14ad8b5c67c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8973f1-50b4-411c-a1f9-080c9cd2ad22),volume_type_id=6c8973f1-50b4-411c-a1f9-080c9cd2ad22)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:41.879637 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf5eec4-e156-4bd4-902a-256429c913a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:41.891743 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf5eec4-e156-4bd4-902a-256429c913a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:41.904799 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5f38af-8f5f-4748-930e-3c29a1b12603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:41.915385 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5f38af-8f5f-4748-930e-3c29a1b12603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bb0d286-209c-4e09-b87b-c99c2ce1fc04', 'volume_name': 'volume-6bb0d286-209c-4e09-b87b-c99c2ce1fc04', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:41.927257 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413dec19-679f-49ea-85a1-d4078a72f7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:41.958796 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413dec19-679f-49ea-85a1-d4078a72f7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:41.972012 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba12e06-2a1b-4ad1-856e-d509cb4dc750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:41.976093 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Volume 6bb0d286-209c-4e09-b87b-c99c2ce1fc04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bb0d286-209c-4e09-b87b-c99c2ce1fc04', 'volume_size': 1} Jul 30 21:28:41.977274 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] creating volume 'volume-6bb0d286-209c-4e09-b87b-c99c2ce1fc04' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:41.980653 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:42.141125 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:42.141508 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:42.146863 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba12e06-2a1b-4ad1-856e-d509cb4dc750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bb0d286-209c-4e09-b87b-c99c2ce1fc04', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:42.164220 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d758d513-6c71-4757-a329-8c13a217967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:42.195018 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:42.300751 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:42.301187 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] Volume volume-e6b5d1c2-3bde-401c-9f14-8d23cd3fd891 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:42.314026 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] deleting rbd volume volume-e6b5d1c2-3bde-401c-9f14-8d23cd3fd891 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:42.316435 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Volume volume-6bb0d286-209c-4e09-b87b-c99c2ce1fc04 (6bb0d286-209c-4e09-b87b-c99c2ce1fc04): created successfully Jul 30 21:28:42.321016 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d758d513-6c71-4757-a329-8c13a217967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:42.329038 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Flow 'volume_create_manager' (18f6f535-26d3-4821-a169-8683f0f6bf7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:42.359494 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-6239f6d1-991d-42a9-b6ec-bb2253f87e56 tempest-GroupsTest-405631875 None] Created volume successfully. Jul 30 21:28:42.793927 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1694961525 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1694961525, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:28:42.796040 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1694961525 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1694961525, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:28:42.841185 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] Created reservations ['17d67b5d-84f6-40a8-b84e-f6a55aa9e45d', 'b129aa02-9fcd-467a-9c31-10d8fc51c3c1', '1274a218-58ae-4de6-9adc-d0677cd4b150', '18f4d7bb-35f6-47bf-86e3-c8ace4c36e1f'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:42.936604 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:43.023379 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:43.134987 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:43.141607 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] Deleted volume successfully. Jul 30 21:28:43.169255 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-773152b1-f2b3-4eb4-9d46-56b1798b839c tempest-VolumeTypesTest-1214572047 None] Lock "cinder-e6b5d1c2-3bde-401c-9f14-8d23cd3fd891-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:43.690313 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:43.757612 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Flow 'volume_create_manager' (10c431b3-6d03-4749-bccc-3de644dc3ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:43.782935 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd244fd7-39b9-4962-8a0a-3bdda8347ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:43.807188 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd244fd7-39b9-4962-8a0a-3bdda8347ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1633227932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ad5585a-6089-43a9-855d-2b4f301f4070,host='ncdv-master-1@ceph#ceph',id=0954648f-785a-48be-a5be-9cce8824ba88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2dc8f7f209747caa4acb5ca89b4ed99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:44Z,use_quota=True,user_id='04891d42f10d43e9b95e14ad8b5c67c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c8973f1-50b4-411c-a1f9-080c9cd2ad22),volume_type_id=6c8973f1-50b4-411c-a1f9-080c9cd2ad22)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:43.815508 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4690f9-6536-40ae-ba52-04b3a0bacbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:43.820408 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4690f9-6536-40ae-ba52-04b3a0bacbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:43.826713 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9774532d-dced-44cb-a9b9-c7322e4c468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:43.831038 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9774532d-dced-44cb-a9b9-c7322e4c468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0954648f-785a-48be-a5be-9cce8824ba88', 'volume_name': 'volume-0954648f-785a-48be-a5be-9cce8824ba88', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:43.839091 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb720da-bcc8-454a-a87f-dac9e553d04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:43.844333 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb720da-bcc8-454a-a87f-dac9e553d04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:43.850537 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a5e3c9-d28e-4ea3-ad37-42c95a9f6d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:43.853261 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Volume 0954648f-785a-48be-a5be-9cce8824ba88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0954648f-785a-48be-a5be-9cce8824ba88', 'volume_size': 1} Jul 30 21:28:43.853835 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] creating volume 'volume-0954648f-785a-48be-a5be-9cce8824ba88' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:43.854832 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:43.961047 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:43.961613 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:43.967017 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a5e3c9-d28e-4ea3-ad37-42c95a9f6d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0954648f-785a-48be-a5be-9cce8824ba88', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:43.976478 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456e44f9-d9b7-45bb-b76e-cbeb4e3c3236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:44.012842 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Volume volume-0954648f-785a-48be-a5be-9cce8824ba88 (0954648f-785a-48be-a5be-9cce8824ba88): created successfully Jul 30 21:28:44.013540 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456e44f9-d9b7-45bb-b76e-cbeb4e3c3236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:44.024767 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Flow 'volume_create_manager' (10c431b3-6d03-4749-bccc-3de644dc3ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:44.043602 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e464d224-6990-42f5-aa29-fcb65484c969 tempest-GroupsTest-405631875 None] Created volume successfully. Jul 30 21:28:44.320479 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:44.361626 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Flow 'volume_create_manager' (3f626cb8-e1af-45f9-8236-c815ebfb4d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:44.381023 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f398d0c-4618-4a3d-9a28-902c35aaabfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:44.420674 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f398d0c-4618-4a3d-9a28-902c35aaabfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1023974276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e478f336-9081-4a96-a3a4-3aa81ea864ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1833a6aa44b4d72bc3c3bd2cc061645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:44Z,use_quota=True,user_id='028bc898819246e481a3f7fb20195f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:44.430001 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c9d9f8-7ef9-4aa8-a153-d3ddc623f8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:44.440624 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c9d9f8-7ef9-4aa8-a153-d3ddc623f8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:44.454985 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357a0ebf-0625-4f39-866e-d6224236963b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:44.609990 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357a0ebf-0625-4f39-866e-d6224236963b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e478f336-9081-4a96-a3a4-3aa81ea864ae', 'volume_name': 'volume-e478f336-9081-4a96-a3a4-3aa81ea864ae', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:44.615186 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d822613b-180d-42a6-ba93-b933e7a4c1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:44.621363 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d822613b-180d-42a6-ba93-b933e7a4c1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:44.625972 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff65715-3da2-42f5-9038-6d34a8240959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:44.627698 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Volume e478f336-9081-4a96-a3a4-3aa81ea864ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e478f336-9081-4a96-a3a4-3aa81ea864ae', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:28:44.628556 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Cloning e478f336-9081-4a96-a3a4-3aa81ea864ae from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:28:44.630139 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:44.639828 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:44.654467 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 28, 44, 644806)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:28:44.655241 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:28:44.655881 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:28:44.674270 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.033s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:44.675729 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:28:44.678515 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=69,cinder:DELETE=2,cinder:UPDATE=26,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:44.687352 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 28, 44, 681597)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:28:44.687931 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:28:44.688710 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:28:44.710817 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:44.828283 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] creating snapshot='volume-e478f336-9081-4a96-a3a4-3aa81ea864ae.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:28:45.906470 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-e478f336-9081-4a96-a3a4-3aa81ea864ae.clone_snap' to 'volume-e478f336-9081-4a96-a3a4-3aa81ea864ae' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:28:46.088125 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:46.136799 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (3eef00ee-8f91-4064-9332-3fb335b452e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:46.153090 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef518e9-91f9-47d2-98fc-6732b48d90ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:46.234724 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:46.236826 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:46.236826 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:46.295711 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:28:46.296683 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Marking volume e478f336-9081-4a96-a3a4-3aa81ea864ae as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:28:46.330773 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef518e9-91f9-47d2-98fc-6732b48d90ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1189693194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ba171381-4e8a-4e54-be59-505bab4c3630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418ff359f7a747e58ae4fdf0c4b7072a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:45Z,use_quota=True,user_id='db01f9802e8147b8bdabfc9bbbbd7bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:46.345009 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184bf2cf-eba9-47d9-9a23-b700e6a215a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:46.352945 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184bf2cf-eba9-47d9-9a23-b700e6a215a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:46.364248 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78c23a4-9745-4923-b138-440b28702f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:46.392681 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78c23a4-9745-4923-b138-440b28702f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba171381-4e8a-4e54-be59-505bab4c3630', 'volume_name': 'volume-ba171381-4e8a-4e54-be59-505bab4c3630', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:46.407793 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775517c4-3899-490d-98b7-5b33ceb0fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:46.412000 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775517c4-3899-490d-98b7-5b33ceb0fc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:46.422905 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457aaf1a-cecb-44e8-a175-262da7405cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:46.426265 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Volume ba171381-4e8a-4e54-be59-505bab4c3630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba171381-4e8a-4e54-be59-505bab4c3630', 'volume_size': 1} Jul 30 21:28:46.429066 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] creating volume 'volume-ba171381-4e8a-4e54-be59-505bab4c3630' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:46.432028 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:46.490766 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to e478f336-9081-4a96-a3a4-3aa81ea864ae. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:28:46.492061 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Creating volume glance metadata for volume e478f336-9081-4a96-a3a4-3aa81ea864ae backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:28:46.539598 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b81f04a6-f1d0-4c99-b28b-7c8e1f260481 tempest-GroupsTest-405631875 None] Update group completed successfully. Jul 30 21:28:46.583705 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:46.584090 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:46.587885 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457aaf1a-cecb-44e8-a175-262da7405cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba171381-4e8a-4e54-be59-505bab4c3630', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:46.597653 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e17a88f-c19f-483a-8589-95e48df8db43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:46.626346 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Volume volume-ba171381-4e8a-4e54-be59-505bab4c3630 (ba171381-4e8a-4e54-be59-505bab4c3630): created successfully Jul 30 21:28:46.636676 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e17a88f-c19f-483a-8589-95e48df8db43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:46.659179 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (3eef00ee-8f91-4064-9332-3fb335b452e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:46.688375 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b9302441-4fcd-43b7-ae1b-e54c70f0715d tempest-VolumesActionsTest-1856691178 None] Created volume successfully. Jul 30 21:28:46.725999 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff65715-3da2-42f5-9038-6d34a8240959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e478f336-9081-4a96-a3a4-3aa81ea864ae', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:46.732906 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c13fae-901c-45e4-8bac-f2d28315ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:46.764332 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Volume volume-e478f336-9081-4a96-a3a4-3aa81ea864ae (e478f336-9081-4a96-a3a4-3aa81ea864ae): created successfully Jul 30 21:28:46.769357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c13fae-901c-45e4-8bac-f2d28315ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:46.774798 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Flow 'volume_create_manager' (3f626cb8-e1af-45f9-8236-c815ebfb4d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:46.797411 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-66fb04a2-425e-4561-af4b-cf30660bfcbd tempest-VolumesImageMetadata-522825660 None] Created volume successfully. Jul 30 21:28:47.725244 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b3d4a370-79ff-461d-ace9-972ae91c7eb2 tempest-GroupsTest-405631875 None] Update group completed successfully. Jul 30 21:28:47.773188 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] Acquiring lock "cinder-ba171381-4e8a-4e54-be59-505bab4c3630-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:47.788738 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] Lock "cinder-ba171381-4e8a-4e54-be59-505bab4c3630-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:47.884030 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:47.997221 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:47.997893 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] Volume volume-ba171381-4e8a-4e54-be59-505bab4c3630 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:48.009233 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] deleting rbd volume volume-ba171381-4e8a-4e54-be59-505bab4c3630 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:48.298106 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] Acquiring lock "cinder-e478f336-9081-4a96-a3a4-3aa81ea864ae-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:48.344182 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] Lock "cinder-e478f336-9081-4a96-a3a4-3aa81ea864ae-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:48.467271 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:48.586846 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:48.600576 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] deleting rbd volume volume-e478f336-9081-4a96-a3a4-3aa81ea864ae {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:48.656655 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] Created reservations ['04dcf904-5721-44df-b511-168990652808', '7ee969dd-fb10-4de8-91a1-81f62444c506', 'ca902006-df70-4ad7-99f6-dc4b369bc363', 'd9073ce4-97ec-4ad9-b16d-bfd7f7b40f9c'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:48.785008 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:48.870620 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:48.939429 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:48.945389 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] Deleted volume successfully. Jul 30 21:28:48.969223 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8165e015-a3d6-4721-a809-2f17bcc278d4 tempest-VolumesActionsTest-1888943910 None] Lock "cinder-ba171381-4e8a-4e54-be59-505bab4c3630-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:48.988168 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:28:49.060934 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] deleting parent snapshot volume-e478f336-9081-4a96-a3a4-3aa81ea864ae.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:28:49.469630 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=70,cinder:UPDATE=18,cinder:DELETE=4,cinder:INSERT=8 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:49.540641 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] Created reservations ['14fe9440-3e3c-4629-bd45-6cb42f239b10', '8a29fa5f-5e73-433f-90d5-a7bd96cb0bde', '0f949076-e990-42c5-a0af-c86f93e78e90', '14bd77b4-1040-4ab9-8f0d-00a906966d54'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:49.605384 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:49.708410 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:49.708838 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] Volume volume-0954648f-785a-48be-a5be-9cce8824ba88 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:49.725991 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] deleting rbd volume volume-0954648f-785a-48be-a5be-9cce8824ba88 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:49.813090 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=31,cinder:SELECT=53,cinder:INSERT=14,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:49.820382 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:49.868787 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (f9a96975-1098-409b-bec6-425422749c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:49.879013 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085e1d1f-3f75-400c-92f9-fcd74dbd317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:49.893613 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:49.934582 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:49.995089 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:50.008417 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] Deleted volume successfully. Jul 30 21:28:50.044875 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085e1d1f-3f75-400c-92f9-fcd74dbd317b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1534030791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bbcdca76-8f5c-4e35-9fae-7e70eca12e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418ff359f7a747e58ae4fdf0c4b7072a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:50Z,use_quota=True,user_id='db01f9802e8147b8bdabfc9bbbbd7bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:50.066937 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7f89d4-6663-4fba-9aed-2b592e66eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:50.074084 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7f89d4-6663-4fba-9aed-2b592e66eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:50.088818 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf088d6b-3a92-43b0-9aec-27dd86dac793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:50.095234 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf088d6b-3a92-43b0-9aec-27dd86dac793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbcdca76-8f5c-4e35-9fae-7e70eca12e37', 'volume_name': 'volume-bbcdca76-8f5c-4e35-9fae-7e70eca12e37', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:50.104401 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd4d2d4-3c04-4743-821f-9b4281ce6a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:50.110924 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd4d2d4-3c04-4743-821f-9b4281ce6a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:50.116592 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a905c1-1f98-4f18-b2fb-2b72220b7e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:50.117991 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Volume bbcdca76-8f5c-4e35-9fae-7e70eca12e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbcdca76-8f5c-4e35-9fae-7e70eca12e37', 'volume_size': 1} Jul 30 21:28:50.118621 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] creating volume 'volume-bbcdca76-8f5c-4e35-9fae-7e70eca12e37' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:50.119522 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:50.159830 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:50.240097 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:50.240600 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] Volume volume-6bb0d286-209c-4e09-b87b-c99c2ce1fc04 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:50.248910 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] deleting rbd volume volume-6bb0d286-209c-4e09-b87b-c99c2ce1fc04 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:50.261756 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:50.262365 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:50.269675 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a905c1-1f98-4f18-b2fb-2b72220b7e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbcdca76-8f5c-4e35-9fae-7e70eca12e37', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:50.279832 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb49cb4-a76b-41d0-b05c-b33aa2310614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:50.294855 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-714934f4-c0e9-4527-b433-d24a1a54e5e6 tempest-VolumesImageMetadata-522825660 None] Lock "cinder-e478f336-9081-4a96-a3a4-3aa81ea864ae-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:50.306728 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Volume volume-bbcdca76-8f5c-4e35-9fae-7e70eca12e37 (bbcdca76-8f5c-4e35-9fae-7e70eca12e37): created successfully Jul 30 21:28:50.306728 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb49cb4-a76b-41d0-b05c-b33aa2310614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:50.314357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (f9a96975-1098-409b-bec6-425422749c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:50.328040 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8733614b-9a85-4a4b-abc1-e2dece0a0711 tempest-VolumesActionsTest-1856691178 None] Created volume successfully. Jul 30 21:28:50.695115 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] Created reservations ['2f0ada11-8ff2-4d2f-aa79-1f7fcce37830'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:50.740079 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1970680009 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1970680009, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:28:50.744990 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1970680009 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1970680009, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:28:50.783932 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] Created reservations ['3bb1533d-0deb-46e8-aa04-d4786dd71996', '76ad2630-f737-475a-94c0-d7d19a8693a2', '56731280-1227-4354-ac5c-99ae9c313590', '9ed4a44e-ff64-4ae8-ac34-963c493a168b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:50.925829 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] Created reservations ['8dcdd3b0-505f-4b47-a585-6ce37dad3330', 'e50298e1-d4d2-4fc0-9898-9da97d65e14b', '911064ab-6efd-4b4e-ab69-70b7bce6f55f', 'd283322f-ad57-4c8e-935e-fe5c1e3591e1'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:51.115249 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:51.203261 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:51.300687 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:51.305251 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8dcc4cd5-f2b3-4867-9d98-69d847d7c438 tempest-GroupsTest-405631875 None] Delete group completed successfully. Jul 30 21:28:51.433779 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] Acquiring lock "cinder-bbcdca76-8f5c-4e35-9fae-7e70eca12e37-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:51.455382 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] Lock "cinder-bbcdca76-8f5c-4e35-9fae-7e70eca12e37-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:51.517304 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:51.603533 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:51.604215 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] Volume volume-bbcdca76-8f5c-4e35-9fae-7e70eca12e37 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:51.609414 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] deleting rbd volume volume-bbcdca76-8f5c-4e35-9fae-7e70eca12e37 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:51.642341 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:51.672871 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Flow 'volume_create_manager' (5f937d69-3777-4fb3-a766-6fcd5fdb8f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:51.680257 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc59b2e-8cfc-4dec-a824-3b5a37e070c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:51.704956 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc59b2e-8cfc-4dec-a824-3b5a37e070c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1971950876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9f6948f8-0361-49db-8527-fde062205989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c913d686f4bb4e968a757bef17ddb707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:52Z,use_quota=True,user_id='3912ff33d4e14b50a774bb46d09c6e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:51.711067 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52411d68-c748-4caa-bacb-918fbba1695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:51.715915 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52411d68-c748-4caa-bacb-918fbba1695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:51.723262 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd081801-b1bc-478d-b637-c6f3a9ad1d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:51.728282 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd081801-b1bc-478d-b637-c6f3a9ad1d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6948f8-0361-49db-8527-fde062205989', 'volume_name': 'volume-9f6948f8-0361-49db-8527-fde062205989', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:51.735060 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956da0dc-7346-436c-a147-4437de283004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:51.739190 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956da0dc-7346-436c-a147-4437de283004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:51.744789 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e4005c-a158-43e0-a5c0-3747a65feb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:51.745893 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Volume 9f6948f8-0361-49db-8527-fde062205989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6948f8-0361-49db-8527-fde062205989', 'volume_size': 1} Jul 30 21:28:51.746356 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] creating volume 'volume-9f6948f8-0361-49db-8527-fde062205989' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:51.747698 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:51.944491 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:51.945204 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:51.948590 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e4005c-a158-43e0-a5c0-3747a65feb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6948f8-0361-49db-8527-fde062205989', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:51.953424 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ae7f31-4510-420a-82bb-00ace9ffb644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:51.977790 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Volume volume-9f6948f8-0361-49db-8527-fde062205989 (9f6948f8-0361-49db-8527-fde062205989): created successfully Jul 30 21:28:51.983545 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ae7f31-4510-420a-82bb-00ace9ffb644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:52.012513 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Flow 'volume_create_manager' (5f937d69-3777-4fb3-a766-6fcd5fdb8f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:52.049868 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c3548ed9-71e2-460d-ab40-975a22fa2236 tempest-VolumesBackupsAdminTest-909892006 None] Created volume successfully. Jul 30 21:28:52.101869 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] Created reservations ['66f801ce-0a54-408e-9a84-fc5dab075f4c', 'd3fdcd0c-7d74-402f-94a1-3c5a2b50c2fb', 'cdffd3aa-925f-498b-a2bd-14408df1aeea', '3637c1cd-e0b6-4a7d-b61b-d57612bfa4bf'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:52.194015 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:52.248951 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:52.315729 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:52.329740 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] Deleted volume successfully. Jul 30 21:28:52.347885 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-72504505-c897-4539-92ab-3ac4a5a896e5 tempest-VolumesActionsTest-1888943910 None] Lock "cinder-bbcdca76-8f5c-4e35-9fae-7e70eca12e37-delete_volume" released by "delete_volume" :: held 0.892s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:52.989488 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-509d74b3-f01e-4e8b-8de2-49698011c872 tempest-VolumesBackupsAdminTest-909892006 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-30T21:28:52Z,data_timestamp=2022-07-30T21:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-302495652',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=fb0d61b1-759f-41c7-9356-8db8b3732550,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c913d686f4bb4e968a757bef17ddb707',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3912ff33d4e14b50a774bb46d09c6e80',volume_id=9f6948f8-0361-49db-8527-fde062205989) Jul 30 21:28:53.003776 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.backup.rpcapi [None req-509d74b3-f01e-4e8b-8de2-49698011c872 tempest-VolumesBackupsAdminTest-909892006 None] continue_backup in rpcapi backup_id fb0d61b1-759f-41c7-9356-8db8b3732550 {{(pid=124008) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jul 30 21:28:53.253611 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:53.291593 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (41ea8e95-b709-4f29-ab40-b7712855c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:53.302164 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212af65c-d766-44b0-abc9-8415d17588ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:53.311845 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-509d74b3-f01e-4e8b-8de2-49698011c872 tempest-VolumesBackupsAdminTest-909892006 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:28:53.349941 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212af65c-d766-44b0-abc9-8415d17588ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1167276062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=77c7ee47-b075-4d67-a12c-01b40fbeb953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418ff359f7a747e58ae4fdf0c4b7072a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:53Z,use_quota=True,user_id='db01f9802e8147b8bdabfc9bbbbd7bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:53.356258 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6430413-c1cb-499c-8ce2-e1a878a497a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:53.361276 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6430413-c1cb-499c-8ce2-e1a878a497a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:53.366434 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f196adc-3420-4788-867a-7b780601a9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:53.372102 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f196adc-3420-4788-867a-7b780601a9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c7ee47-b075-4d67-a12c-01b40fbeb953', 'volume_name': 'volume-77c7ee47-b075-4d67-a12c-01b40fbeb953', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:53.381899 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0485fdef-91e9-4239-85b5-0c76d35c0899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:53.387444 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0485fdef-91e9-4239-85b5-0c76d35c0899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:53.393421 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18834005-b754-47ce-93bc-990e5e040de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:53.395848 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Volume 77c7ee47-b075-4d67-a12c-01b40fbeb953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c7ee47-b075-4d67-a12c-01b40fbeb953', 'volume_size': 1} Jul 30 21:28:53.396296 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] creating volume 'volume-77c7ee47-b075-4d67-a12c-01b40fbeb953' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:53.397621 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:53.532880 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:53.533305 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:53.539750 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18834005-b754-47ce-93bc-990e5e040de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c7ee47-b075-4d67-a12c-01b40fbeb953', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:53.547554 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073618bc-b88a-42f8-a748-e6a4305eb3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:53.564088 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Volume volume-77c7ee47-b075-4d67-a12c-01b40fbeb953 (77c7ee47-b075-4d67-a12c-01b40fbeb953): created successfully Jul 30 21:28:53.570608 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073618bc-b88a-42f8-a748-e6a4305eb3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:53.580382 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (41ea8e95-b709-4f29-ab40-b7712855c404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:53.597366 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-621096ee-3232-4b41-80b0-aa41013728f8 tempest-VolumesActionsTest-1856691178 None] Created volume successfully. Jul 30 21:28:54.447773 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:54.493057 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Flow 'volume_create_manager' (b6eb79a7-ccf2-488c-b0e1-613cc12feb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:54.511346 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad352b8-a8f1-4414-9a8c-bdd279ffc230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:54.533248 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad352b8-a8f1-4414-9a8c-bdd279ffc230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-216669189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8f852c0e-e993-426f-8e55-5692468d148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf1fb0c4cac401f925e3522776dbdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:54Z,use_quota=True,user_id='a4136d1c05b649f1be0ae0219d7b6b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:54.541413 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc7f8cd-5303-441b-8472-ee823ef83180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:54.547441 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc7f8cd-5303-441b-8472-ee823ef83180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:54.555084 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9021b7ef-221f-405c-807c-583e0f9cd9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:54.561074 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9021b7ef-221f-405c-807c-583e0f9cd9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f852c0e-e993-426f-8e55-5692468d148e', 'volume_name': 'volume-8f852c0e-e993-426f-8e55-5692468d148e', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:54.569845 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87539183-f426-49c8-a1fe-d3359358dd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:54.575957 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87539183-f426-49c8-a1fe-d3359358dd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:54.581769 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca56f78-cfef-449a-b774-94f5793ecfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:54.583255 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Volume 8f852c0e-e993-426f-8e55-5692468d148e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f852c0e-e993-426f-8e55-5692468d148e', 'volume_size': 1} Jul 30 21:28:54.583855 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] creating volume 'volume-8f852c0e-e993-426f-8e55-5692468d148e' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:54.584833 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:54.732730 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:54.733201 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:54.737819 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca56f78-cfef-449a-b774-94f5793ecfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f852c0e-e993-426f-8e55-5692468d148e', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:54.749097 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c83f14-cd6c-4d26-937e-ee2179e45984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:54.777198 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-509d74b3-f01e-4e8b-8de2-49698011c872 tempest-VolumesBackupsAdminTest-909892006 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.466s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:28:54.787081 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] Acquiring lock "cinder-77c7ee47-b075-4d67-a12c-01b40fbeb953-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:54.789759 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-509d74b3-f01e-4e8b-8de2-49698011c872 tempest-VolumesBackupsAdminTest-909892006 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9f6948f8-0361-49db-8527-fde062205989', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '9f6948f8-0361-49db-8527-fde062205989', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:28:54.816457 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Volume volume-8f852c0e-e993-426f-8e55-5692468d148e (8f852c0e-e993-426f-8e55-5692468d148e): created successfully Jul 30 21:28:54.819986 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c83f14-cd6c-4d26-937e-ee2179e45984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:54.839129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Flow 'volume_create_manager' (b6eb79a7-ccf2-488c-b0e1-613cc12feb5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:54.863800 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=34,cinder:SELECT=55,cinder:DELETE=3,cinder:INSERT=8 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:54.866432 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3aa13fb7-4688-4deb-8469-a681d011f184 tempest-SnapshotMetadataTestJSON-1629814673 None] Created volume successfully. Jul 30 21:28:54.869165 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-509d74b3-f01e-4e8b-8de2-49698011c872 tempest-VolumesBackupsAdminTest-909892006 None] Initialize volume connection completed successfully. Jul 30 21:28:54.873650 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] Lock "cinder-77c7ee47-b075-4d67-a12c-01b40fbeb953-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:54.901538 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=57,cinder:DELETE=3,cinder:UPDATE=35,cinder:INSERT=5 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:28:54.926486 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:55.026810 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:55.027387 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] Volume volume-77c7ee47-b075-4d67-a12c-01b40fbeb953 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:55.041373 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] deleting rbd volume volume-77c7ee47-b075-4d67-a12c-01b40fbeb953 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:55.597546 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] Created reservations ['da7214c6-1e8b-41eb-8dd4-7d267964c41d', 'b27976b1-c247-43c9-9cf5-fecc6884dca1', 'd072956b-632c-4dd0-b72b-5697faa59632', 'c5633a18-6de0-419f-a30c-76931af06c72'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:55.741350 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:55.813929 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:55.889283 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:55.900220 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] Deleted volume successfully. Jul 30 21:28:55.937831 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0befce1b-0161-42d0-a06e-41476f254bcb tempest-VolumesActionsTest-1888943910 None] Lock "cinder-77c7ee47-b075-4d67-a12c-01b40fbeb953-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:56.055898 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a7588c71-a28a-479d-befe-6ae97972c829 tempest-SnapshotMetadataTestJSON-1629814673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:56.428095 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a7588c71-a28a-479d-befe-6ae97972c829 tempest-SnapshotMetadataTestJSON-1629814673 None] Create snapshot completed successfully Jul 30 21:28:56.680728 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:56.722044 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (19e6ccb2-5578-48f4-9477-8976e2ce4df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:56.729624 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f9fa8c-baab-43bb-8ec2-3f99340279a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:56.764107 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f9fa8c-baab-43bb-8ec2-3f99340279a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1667600934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b9113826-79c4-47cf-8cb0-f663f0ef0327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418ff359f7a747e58ae4fdf0c4b7072a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:57Z,use_quota=True,user_id='db01f9802e8147b8bdabfc9bbbbd7bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:56.770948 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f29cce3-51e0-41f1-aad9-a9aca114c760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:56.776745 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f29cce3-51e0-41f1-aad9-a9aca114c760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:56.782714 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929f7f7b-ea99-4bb6-91bb-6360d9a37d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:56.791918 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929f7f7b-ea99-4bb6-91bb-6360d9a37d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9113826-79c4-47cf-8cb0-f663f0ef0327', 'volume_name': 'volume-b9113826-79c4-47cf-8cb0-f663f0ef0327', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:56.799955 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b6a5c9-1460-42fe-ad5a-3e8e5dfa5269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:56.804573 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b6a5c9-1460-42fe-ad5a-3e8e5dfa5269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:56.810931 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317191a7-20b8-4666-96a7-087baf76a801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:56.812130 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Volume b9113826-79c4-47cf-8cb0-f663f0ef0327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9113826-79c4-47cf-8cb0-f663f0ef0327', 'volume_size': 1} Jul 30 21:28:56.812520 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] creating volume 'volume-b9113826-79c4-47cf-8cb0-f663f0ef0327' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:56.813315 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:56.940509 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:56.940864 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:56.944583 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317191a7-20b8-4666-96a7-087baf76a801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9113826-79c4-47cf-8cb0-f663f0ef0327', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:56.952550 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdd5159-322d-4ccf-991b-554c611e828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:56.970817 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Volume volume-b9113826-79c4-47cf-8cb0-f663f0ef0327 (b9113826-79c4-47cf-8cb0-f663f0ef0327): created successfully Jul 30 21:28:56.980257 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdd5159-322d-4ccf-991b-554c611e828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:56.992044 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (19e6ccb2-5578-48f4-9477-8976e2ce4df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:57.034384 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f298d2a2-7377-41d6-bab3-eee08adc3a65 tempest-VolumesActionsTest-1856691178 None] Created volume successfully. Jul 30 21:28:57.052652 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:28:57.112160 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Flow 'volume_create_manager' (8d825c51-9fe9-4ef9-9abe-169b9628cfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:57.131753 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab27c40-602e-4487-8370-1892fdc3b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:57.163344 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab27c40-602e-4487-8370-1892fdc3b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-589458554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b649d11c-51e4-4fa9-ae7e-5d7ea3340f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feefda34901f4756a13758920c53a1e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:28:57Z,use_quota=True,user_id='e0d7d5bc71154c04a2966aafc81d80c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:57.187153 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07a1605-1f70-4510-bcb3-7e4ba94923ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:57.199200 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07a1605-1f70-4510-bcb3-7e4ba94923ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:57.210618 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce71a35-ad3e-4433-a5e3-3b33f5c426e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:57.222525 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce71a35-ad3e-4433-a5e3-3b33f5c426e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b649d11c-51e4-4fa9-ae7e-5d7ea3340f82', 'volume_name': 'volume-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:57.228603 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d798f855-12a5-4cc7-a245-a2c11d719f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:57.235009 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d798f855-12a5-4cc7-a245-a2c11d719f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:57.241189 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3743cde2-ea53-49e6-81fe-384dc360f014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:57.242666 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Volume b649d11c-51e4-4fa9-ae7e-5d7ea3340f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82', 'volume_size': 1} Jul 30 21:28:57.243421 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] creating volume 'volume-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:28:57.244221 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:57.370108 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:28:57.372783 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:28:57.381208 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3743cde2-ea53-49e6-81fe-384dc360f014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:57.394334 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afe07ad-c66e-4c90-a0ef-9c4137cd7b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:28:57.421721 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Volume volume-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82 (b649d11c-51e4-4fa9-ae7e-5d7ea3340f82): created successfully Jul 30 21:28:57.425524 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afe07ad-c66e-4c90-a0ef-9c4137cd7b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:28:57.437994 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Flow 'volume_create_manager' (8d825c51-9fe9-4ef9-9abe-169b9628cfea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:28:57.457134 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-32f74ec2-5bf6-4e94-b094-129d7bc9ffa4 tempest-VolumesBackupsV39Test-839346308 None] Created volume successfully. Jul 30 21:28:57.832257 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-509d74b3-f01e-4e8b-8de2-49698011c872 tempest-VolumesBackupsAdminTest-909892006 None] Terminate volume connection completed successfully. Jul 30 21:28:57.868388 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-509d74b3-f01e-4e8b-8de2-49698011c872 tempest-VolumesBackupsAdminTest-909892006 None] Remove volume export completed successfully. Jul 30 21:28:58.243203 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] Acquiring lock "cinder-b9113826-79c4-47cf-8cb0-f663f0ef0327-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:58.268476 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] Lock "cinder-b9113826-79c4-47cf-8cb0-f663f0ef0327-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:58.389141 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:58.516958 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:28:58.518301 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] Volume volume-b9113826-79c4-47cf-8cb0-f663f0ef0327 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:28:58.530523 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] deleting rbd volume volume-b9113826-79c4-47cf-8cb0-f663f0ef0327 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:28:58.585091 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-dbcac829-f835-4d12-996c-bfa4535ae112 tempest-VolumesBackupsV39Test-839346308 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-30T21:28:58Z,data_timestamp=2022-07-30T21:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-2145480734',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=d4efdf8b-581d-4624-8e67-be2a3a9ba890,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='feefda34901f4756a13758920c53a1e6',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e0d7d5bc71154c04a2966aafc81d80c5',volume_id=b649d11c-51e4-4fa9-ae7e-5d7ea3340f82) Jul 30 21:28:58.587876 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.backup.rpcapi [None req-dbcac829-f835-4d12-996c-bfa4535ae112 tempest-VolumesBackupsV39Test-839346308 None] continue_backup in rpcapi backup_id d4efdf8b-581d-4624-8e67-be2a3a9ba890 {{(pid=124008) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jul 30 21:28:58.682299 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bc431dfa-077c-4cbd-ac62-3b7b3cc34fbb tempest-SnapshotMetadataTestJSON-1629814673 None] Acquiring lock "cinder-368fc6ac-6dd1-401c-b50a-797423172941-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:28:58.732181 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bc431dfa-077c-4cbd-ac62-3b7b3cc34fbb tempest-SnapshotMetadataTestJSON-1629814673 None] Lock "cinder-368fc6ac-6dd1-401c-b50a-797423172941-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:28:58.753898 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bc431dfa-077c-4cbd-ac62-3b7b3cc34fbb tempest-SnapshotMetadataTestJSON-1629814673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:58.901030 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-dbcac829-f835-4d12-996c-bfa4535ae112 tempest-VolumesBackupsV39Test-839346308 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:28:59.145589 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] Created reservations ['d64900e1-ce80-4361-a5a8-4eca06fd6201', '9df9451c-6caa-4a24-8c43-101567e7d23a', '1d6d64b6-1f7b-47a6-8878-ec83ca34b851', '7add6f99-ef46-498f-bb06-a65377a85028'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:59.235257 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:59.331003 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:28:59.411414 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:28:59.419848 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] Deleted volume successfully. Jul 30 21:28:59.441949 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-32ee00c0-b10c-4ff0-87f7-d44ac0b6a44e tempest-VolumesActionsTest-1888943910 None] Lock "cinder-b9113826-79c4-47cf-8cb0-f663f0ef0327-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:28:59.801976 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-bc431dfa-077c-4cbd-ac62-3b7b3cc34fbb tempest-SnapshotMetadataTestJSON-1629814673 None] Created reservations ['cb128e19-cbda-4d6a-bb5b-3b59f3a8c056', '7f463dac-029c-442d-8bce-a5315c633a5f', 'fc8d6a37-2efe-4c00-8df2-260a235c3e8a', 'd2625765-5e52-4e35-bd63-9a3750696508'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:28:59.905445 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bc431dfa-077c-4cbd-ac62-3b7b3cc34fbb tempest-SnapshotMetadataTestJSON-1629814673 None] Delete snapshot completed successfully. Jul 30 21:28:59.913220 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bc431dfa-077c-4cbd-ac62-3b7b3cc34fbb tempest-SnapshotMetadataTestJSON-1629814673 None] Lock "cinder-368fc6ac-6dd1-401c-b50a-797423172941-delete_snapshot" released by "delete_snapshot" :: held 1.182s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:00.199363 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:00.258408 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (ee12babd-940b-40e3-800a-3b3c75e85f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:00.266503 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64c4676-66b9-4ec5-9125-44fbb7c02fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:00.292404 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64c4676-66b9-4ec5-9125-44fbb7c02fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-93421449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=14018533-69bd-402e-9abf-7ca9191a0c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418ff359f7a747e58ae4fdf0c4b7072a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:00Z,use_quota=True,user_id='db01f9802e8147b8bdabfc9bbbbd7bb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:00.302101 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd697471-7c39-428f-a690-aac0a9a3d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:00.306518 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd697471-7c39-428f-a690-aac0a9a3d33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:00.314804 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df68686b-3612-49b4-af5f-3b4c1baa6892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:00.319912 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df68686b-3612-49b4-af5f-3b4c1baa6892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14018533-69bd-402e-9abf-7ca9191a0c98', 'volume_name': 'volume-14018533-69bd-402e-9abf-7ca9191a0c98', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:00.326201 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5530569-d400-409f-8cd0-058ac9aa8fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:00.330856 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5530569-d400-409f-8cd0-058ac9aa8fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:00.335881 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccfb472-f3a9-4634-8417-027b058d266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:00.337339 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Volume 14018533-69bd-402e-9abf-7ca9191a0c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14018533-69bd-402e-9abf-7ca9191a0c98', 'volume_size': 1} Jul 30 21:29:00.338183 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] creating volume 'volume-14018533-69bd-402e-9abf-7ca9191a0c98' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:00.340811 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:00.457989 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:00.458391 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:00.462015 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccfb472-f3a9-4634-8417-027b058d266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14018533-69bd-402e-9abf-7ca9191a0c98', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:00.467742 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277e0837-3f8f-43c0-8cfc-da795b2249a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:00.493554 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Volume volume-14018533-69bd-402e-9abf-7ca9191a0c98 (14018533-69bd-402e-9abf-7ca9191a0c98): created successfully Jul 30 21:29:00.508032 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277e0837-3f8f-43c0-8cfc-da795b2249a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:00.523016 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Flow 'volume_create_manager' (ee12babd-940b-40e3-800a-3b3c75e85f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:00.526921 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-dbcac829-f835-4d12-996c-bfa4535ae112 tempest-VolumesBackupsV39Test-839346308 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.626s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:29:00.528191 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-dbcac829-f835-4d12-996c-bfa4535ae112 tempest-VolumesBackupsV39Test-839346308 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'b649d11c-51e4-4fa9-ae7e-5d7ea3340f82', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:29:00.547837 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-dbcac829-f835-4d12-996c-bfa4535ae112 tempest-VolumesBackupsV39Test-839346308 None] Initialize volume connection completed successfully. Jul 30 21:29:00.549571 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e8159f63-1b45-4e91-96b3-064bc692d74d tempest-VolumesActionsTest-1856691178 None] Created volume successfully. Jul 30 21:29:00.965161 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] Acquiring lock "cinder-8f852c0e-e993-426f-8e55-5692468d148e-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:00.980452 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] Lock "cinder-8f852c0e-e993-426f-8e55-5692468d148e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:01.088558 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:01.233154 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:01.233748 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] Volume volume-8f852c0e-e993-426f-8e55-5692468d148e is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:01.243166 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] deleting rbd volume volume-8f852c0e-e993-426f-8e55-5692468d148e {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:01.300374 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:01.353799 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Flow 'volume_create_manager' (88228b7d-6bfb-476a-9f52-0d37e13386a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:01.372359 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c66acf4-a56e-4110-bcbc-890bc7d68797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:01.417992 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c66acf4-a56e-4110-bcbc-890bc7d68797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:01Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_fb0d61b1-759f-41c7-9356-8db8b3732550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c0321fbb-b0e2-414a-9c5d-3437ec6c60f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c913d686f4bb4e968a757bef17ddb707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:01Z,use_quota=True,user_id='3912ff33d4e14b50a774bb46d09c6e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:01.431343 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7655ce-0a71-423c-af9e-7192a4ac0a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:01.441689 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7655ce-0a71-423c-af9e-7192a4ac0a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:01.469545 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73f4e50-be15-4fa3-95f4-0d1bc18d3769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:01.481108 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73f4e50-be15-4fa3-95f4-0d1bc18d3769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0321fbb-b0e2-414a-9c5d-3437ec6c60f1', 'volume_name': 'volume-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:01.498619 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f6a73c-c1ae-4368-a263-82c38494a46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:01.504106 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f6a73c-c1ae-4368-a263-82c38494a46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:01.514778 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4846f6bc-3ca5-4bc3-8a7b-187dcd214d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:01.520159 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Volume c0321fbb-b0e2-414a-9c5d-3437ec6c60f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1', 'volume_size': 1} Jul 30 21:29:01.520784 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] creating volume 'volume-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:01.524705 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:01.726202 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:01.726435 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:01.733488 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4846f6bc-3ca5-4bc3-8a7b-187dcd214d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:01.743942 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f48a07a-f156-4439-8c12-83ba289229a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:01.787618 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Volume volume-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1 (c0321fbb-b0e2-414a-9c5d-3437ec6c60f1): created successfully Jul 30 21:29:01.791651 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f48a07a-f156-4439-8c12-83ba289229a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:01.807527 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Flow 'volume_create_manager' (88228b7d-6bfb-476a-9f52-0d37e13386a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:01.807527 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=31,cinder:SELECT=60,cinder:INSERT=5,cinder:DELETE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:01.823886 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Created volume successfully. Jul 30 21:29:01.829035 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=64,cinder:INSERT=7,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:01.890209 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] Created reservations ['c869c061-df6a-4202-ac79-831bf692075b', '39b306a0-751c-4f45-a825-7185904b2a00', 'e22d6ddb-8805-4605-bb4f-5a842896a688', '0ab9dd46-333c-4fcc-877c-03b770249870'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:02.060302 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:02.165572 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:02.284477 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:02.292465 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] Deleted volume successfully. Jul 30 21:29:02.329499 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3481efdb-9eaf-4ef8-ad4e-7f2841c7c8f0 tempest-SnapshotMetadataTestJSON-1629814673 None] Lock "cinder-8f852c0e-e993-426f-8e55-5692468d148e-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:02.454792 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] Acquiring lock "cinder-14018533-69bd-402e-9abf-7ca9191a0c98-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:02.470588 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] Lock "cinder-14018533-69bd-402e-9abf-7ca9191a0c98-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:02.558244 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:29:02.655268 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:02.775489 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:02.776300 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] Volume volume-14018533-69bd-402e-9abf-7ca9191a0c98 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:02.799715 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] deleting rbd volume volume-14018533-69bd-402e-9abf-7ca9191a0c98 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:03.144143 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-dbcac829-f835-4d12-996c-bfa4535ae112 tempest-VolumesBackupsV39Test-839346308 None] Terminate volume connection completed successfully. Jul 30 21:29:03.194858 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-dbcac829-f835-4d12-996c-bfa4535ae112 tempest-VolumesBackupsV39Test-839346308 None] Remove volume export completed successfully. Jul 30 21:29:03.357144 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] Created reservations ['8560388b-2d61-4a4e-98a2-8e665e6b96c9', 'cc14b562-6efe-4e4f-ad3e-e42190bbb21d', 'd2896e09-2a6c-48ab-a4a4-b1e421468736', '0b7ebabd-09b8-4f79-b9b8-c33efde853f7'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:03.430207 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:03.515933 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:03.609577 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:03.628442 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] Deleted volume successfully. Jul 30 21:29:03.669951 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-62c52b12-4d56-4484-af3c-81fe0def688d tempest-VolumesActionsTest-1856691178 None] Lock "cinder-14018533-69bd-402e-9abf-7ca9191a0c98-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:03.867698 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] Acquiring lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:03.879620 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] Lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:03.964619 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:04.046305 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:04.047268 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] Volume volume-67271f6c-0fba-4790-954f-ba1f022aa2aa is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:04.068273 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] deleting rbd volume volume-67271f6c-0fba-4790-954f-ba1f022aa2aa {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:04.085234 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.527s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:29:04.085993 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'c0321fbb-b0e2-414a-9c5d-3437ec6c60f1', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:29:04.121477 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Initialize volume connection completed successfully. Jul 30 21:29:04.527810 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] Created reservations ['5d74c164-2d8e-4482-adcd-8643b256dca6', '0c9f5d49-4a80-4cc1-aa76-33f257a70940', '450c7bc1-c6a7-49a3-89a4-48d6cdeecf19', '535966a3-d57f-4484-b6b5-3a9813e3cf1f'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:04.623482 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:04.702874 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:04.834690 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:04.840796 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] Deleted volume successfully. Jul 30 21:29:04.863770 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8a52e678-c170-4d2e-a140-aa66a848d6ba tempest-VolumesActionsTest-1856691178 None] Lock "cinder-67271f6c-0fba-4790-954f-ba1f022aa2aa-delete_volume" released by "delete_volume" :: held 0.984s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:05.636138 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Terminate volume connection completed successfully. Jul 30 21:29:05.673864 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2267ca94-729b-472e-830e-c9fc90232d7b tempest-VolumesBackupsAdminTest-909892006 None] Remove volume export completed successfully. Jul 30 21:29:06.476224 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] Acquiring lock "cinder-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:06.488559 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] Lock "cinder-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:06.578852 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:06.938213 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] Volume volume-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:06.966764 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] deleting rbd volume volume-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:06.973752 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] Acquiring lock "cinder-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:07.000659 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] Lock "cinder-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:07.085148 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:07.908949 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] Volume volume-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:07.930244 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] deleting rbd volume volume-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:08.019156 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] Created reservations ['7a6c904a-da77-417c-87a6-ce050310ee2d', 'fe759e93-bbb8-42a3-9a67-083a30c2d7f8', '21550f87-b86e-4d7a-b007-ea79d8cd6910', '09a3360f-0b3c-419c-a9c6-e7265d48420f'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:08.089057 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:DELETE=1,cinder:SELECT=56,cinder:INSERT=9,cinder:UPDATE=34 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:08.131770 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:08.212132 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:08.284220 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:08.291434 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] Deleted volume successfully. Jul 30 21:29:08.341770 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-477fdb12-2cff-4f51-bda9-1fb640450dd8 tempest-VolumesBackupsV39Test-839346308 None] Lock "cinder-b649d11c-51e4-4fa9-ae7e-5d7ea3340f82-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:08.410289 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] Created reservations ['eb8dad52-0e0e-4e16-8c8b-da8a46bc5151', '5689757b-c85c-4346-9879-00aac7b782b9', '74bc4b73-1f6e-4dd8-be56-be3aa8ee1a51', 'dc94dc89-8a1c-4477-957d-ec0cc15d666b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:08.415993 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=56,cinder:UPDATE=31,cinder:DELETE=4,cinder:INSERT=9 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:08.522031 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:08.595127 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:08.679146 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:08.684351 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] Deleted volume successfully. Jul 30 21:29:08.703482 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bbe9bb89-5a12-420c-a6bf-042092f45407 tempest-VolumesBackupsAdminTest-909892006 None] Lock "cinder-c0321fbb-b0e2-414a-9c5d-3437ec6c60f1-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:10.760690 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:10.813308 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Flow 'volume_create_manager' (224a2b2a-61aa-40fd-b285-659afd3e2368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:10.821536 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8a097b-a995-47f0-a189-428403145c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:10.841401 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8a097b-a995-47f0-a189-428403145c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-406740042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=85ef6368-9767-491a-a147-537c234ec341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c913d686f4bb4e968a757bef17ddb707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:11Z,use_quota=True,user_id='3912ff33d4e14b50a774bb46d09c6e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:10.849292 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee4fc1c-4f64-4e55-97a1-a0b9558ef359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:10.865331 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee4fc1c-4f64-4e55-97a1-a0b9558ef359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:10.885783 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e5271e-12f5-41ba-a4cf-aa394c08f5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:10.892704 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e5271e-12f5-41ba-a4cf-aa394c08f5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ef6368-9767-491a-a147-537c234ec341', 'volume_name': 'volume-85ef6368-9767-491a-a147-537c234ec341', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:10.901741 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fde94a-2515-46a2-bf57-4783804c602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:10.909624 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fde94a-2515-46a2-bf57-4783804c602d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:10.918017 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a19fc1-e28c-4c5d-a15a-f289d7a7c823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:10.919951 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Volume 85ef6368-9767-491a-a147-537c234ec341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ef6368-9767-491a-a147-537c234ec341', 'volume_size': 1} Jul 30 21:29:10.920503 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] creating volume 'volume-85ef6368-9767-491a-a147-537c234ec341' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:10.921464 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:11.087238 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:11.087631 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:11.092141 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a19fc1-e28c-4c5d-a15a-f289d7a7c823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ef6368-9767-491a-a147-537c234ec341', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:11.100294 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d90a8d6-cb48-4f33-8cce-453441462ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:11.125782 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Volume volume-85ef6368-9767-491a-a147-537c234ec341 (85ef6368-9767-491a-a147-537c234ec341): created successfully Jul 30 21:29:11.130122 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d90a8d6-cb48-4f33-8cce-453441462ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:11.141731 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Flow 'volume_create_manager' (224a2b2a-61aa-40fd-b285-659afd3e2368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:11.167584 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0c1cb2f7-c813-47ca-93b6-8ae433885f4b tempest-VolumesBackupsAdminTest-909892006 None] Created volume successfully. Jul 30 21:29:12.119898 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:12.151716 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Flow 'volume_create_manager' (7bebdb0b-2f92-4b35-be1a-a9b2a2120d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:12.169929 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a699584-8ac4-4dd6-8770-53a66c7a85d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:12.211040 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a699584-8ac4-4dd6-8770-53a66c7a85d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1260152835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=46ab6b42-669f-4b0d-ba75-da1d55253a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='375ed5fbd34c45e6898a93b2c96f1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:12Z,use_quota=True,user_id='91df9f57cf2c4a579856c911e4d370d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:12.221662 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711e36a6-45da-429a-ab7d-fefbc11454c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:12.231081 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711e36a6-45da-429a-ab7d-fefbc11454c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:12.237141 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2aad48d-e620-4a6a-83ee-baf38cf8654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:12.241203 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2aad48d-e620-4a6a-83ee-baf38cf8654b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ab6b42-669f-4b0d-ba75-da1d55253a35', 'volume_name': 'volume-46ab6b42-669f-4b0d-ba75-da1d55253a35', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:12.246116 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b65f71-9961-41c8-99f1-47ef0364bb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:12.250605 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b65f71-9961-41c8-99f1-47ef0364bb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:12.255437 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39ec78b-ba36-40e4-8e41-1618d3b43c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:12.256496 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Volume 46ab6b42-669f-4b0d-ba75-da1d55253a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ab6b42-669f-4b0d-ba75-da1d55253a35', 'volume_size': 1} Jul 30 21:29:12.256886 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] creating volume 'volume-46ab6b42-669f-4b0d-ba75-da1d55253a35' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:12.259091 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:12.345659 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a87de68b-84d4-4e2d-847e-b8be5065311a tempest-VolumesBackupsAdminTest-909892006 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-30T21:29:12Z,data_timestamp=2022-07-30T21:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-187240299',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=bced90b6-ca51-493a-8179-ec7c65b11d04,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c913d686f4bb4e968a757bef17ddb707',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3912ff33d4e14b50a774bb46d09c6e80',volume_id=85ef6368-9767-491a-a147-537c234ec341) Jul 30 21:29:12.349029 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.backup.rpcapi [None req-a87de68b-84d4-4e2d-847e-b8be5065311a tempest-VolumesBackupsAdminTest-909892006 None] continue_backup in rpcapi backup_id bced90b6-ca51-493a-8179-ec7c65b11d04 {{(pid=124008) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jul 30 21:29:12.404987 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:12.405623 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:12.409571 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39ec78b-ba36-40e4-8e41-1618d3b43c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ab6b42-669f-4b0d-ba75-da1d55253a35', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:12.416370 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4040fb68-500d-4969-badd-6cf2e33ebda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:12.451870 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Volume volume-46ab6b42-669f-4b0d-ba75-da1d55253a35 (46ab6b42-669f-4b0d-ba75-da1d55253a35): created successfully Jul 30 21:29:12.457530 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4040fb68-500d-4969-badd-6cf2e33ebda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:12.477203 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Flow 'volume_create_manager' (7bebdb0b-2f92-4b35-be1a-a9b2a2120d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:12.503346 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c1656f61-cf6f-4a67-bba1-09ca5b11a587 tempest-VolumesDeleteCascade-1919992697 None] Created volume successfully. Jul 30 21:29:12.584214 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-a87de68b-84d4-4e2d-847e-b8be5065311a tempest-VolumesBackupsAdminTest-909892006 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:29:13.669701 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ed37ccaa-b6d1-445c-a1b5-3060611bf67b tempest-VolumesDeleteCascade-1919992697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:13.817091 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:13.862082 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Flow 'volume_create_manager' (332dc8de-1150-4b0b-b1b5-83f84256196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:13.873710 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1579a8ca-c182-4247-8b05-c41e2f8881f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:13.917558 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1579a8ca-c182-4247-8b05-c41e2f8881f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1663437337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bd890119-6cdc-4863-a83c-32c26a0ba4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d117513ef948e5ae94772b550f3fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:14Z,use_quota=True,user_id='306267864abe48ad971bbb6956cc7639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:13.937174 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9a8c36-635a-4ae6-9c6e-29525f29753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:13.942656 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9a8c36-635a-4ae6-9c6e-29525f29753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:13.950044 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6043f3c-3fa7-4d16-924d-d7d53200b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:13.955840 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6043f3c-3fa7-4d16-924d-d7d53200b794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd890119-6cdc-4863-a83c-32c26a0ba4b1', 'volume_name': 'volume-bd890119-6cdc-4863-a83c-32c26a0ba4b1', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:13.961847 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1c4996-ed19-4e26-8cee-719e9314a73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:13.968548 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1c4996-ed19-4e26-8cee-719e9314a73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:13.976147 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c63246e-0ebb-427d-a539-9d1048c6bbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:13.978028 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Volume bd890119-6cdc-4863-a83c-32c26a0ba4b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd890119-6cdc-4863-a83c-32c26a0ba4b1', 'volume_size': 1} Jul 30 21:29:13.978866 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] creating volume 'volume-bd890119-6cdc-4863-a83c-32c26a0ba4b1' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:13.980016 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:14.115820 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:14.116191 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:14.120164 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c63246e-0ebb-427d-a539-9d1048c6bbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd890119-6cdc-4863-a83c-32c26a0ba4b1', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:14.128336 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8100a56-1997-409d-b746-4d3a24890e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:14.139723 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-a87de68b-84d4-4e2d-847e-b8be5065311a tempest-VolumesBackupsAdminTest-909892006 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.556s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:29:14.145423 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a87de68b-84d4-4e2d-847e-b8be5065311a tempest-VolumesBackupsAdminTest-909892006 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-85ef6368-9767-491a-a147-537c234ec341', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '85ef6368-9767-491a-a147-537c234ec341', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:29:14.187471 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a87de68b-84d4-4e2d-847e-b8be5065311a tempest-VolumesBackupsAdminTest-909892006 None] Initialize volume connection completed successfully. Jul 30 21:29:14.197714 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Volume volume-bd890119-6cdc-4863-a83c-32c26a0ba4b1 (bd890119-6cdc-4863-a83c-32c26a0ba4b1): created successfully Jul 30 21:29:14.201605 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8100a56-1997-409d-b746-4d3a24890e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:14.209151 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Flow 'volume_create_manager' (332dc8de-1150-4b0b-b1b5-83f84256196c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:14.245948 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3ea1480b-bd19-40ae-a9eb-b8e4d95ca7eb tempest-VolumesMetadataTest-1109008992 None] Created volume successfully. Jul 30 21:29:14.562887 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-ed37ccaa-b6d1-445c-a1b5-3060611bf67b tempest-VolumesDeleteCascade-1919992697 None] Create snapshot completed successfully Jul 30 21:29:15.979634 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:29:15.980489 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:16.038204 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:16.114909 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:16.124472 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] Acquiring lock "cinder-bd890119-6cdc-4863-a83c-32c26a0ba4b1-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:16.171963 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] Lock "cinder-bd890119-6cdc-4863-a83c-32c26a0ba4b1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:16.196551 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ce42aeec-6f4d-4332-aeae-208e9c362fd2 tempest-VolumesDeleteCascade-1919992697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:16.316960 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:16.396277 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:16.396817 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] Volume volume-bd890119-6cdc-4863-a83c-32c26a0ba4b1 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:16.409901 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] deleting rbd volume volume-bd890119-6cdc-4863-a83c-32c26a0ba4b1 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:16.671935 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-ce42aeec-6f4d-4332-aeae-208e9c362fd2 tempest-VolumesDeleteCascade-1919992697 None] Create snapshot completed successfully Jul 30 21:29:16.846659 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a87de68b-84d4-4e2d-847e-b8be5065311a tempest-VolumesBackupsAdminTest-909892006 None] Terminate volume connection completed successfully. Jul 30 21:29:16.908948 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a87de68b-84d4-4e2d-847e-b8be5065311a tempest-VolumesBackupsAdminTest-909892006 None] Remove volume export completed successfully. Jul 30 21:29:16.969431 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] Created reservations ['f3147d6d-e335-45d6-ba3d-6a3c35ecd033', '180a49ab-4fb2-4e1a-ab1d-6acaff65e0d6', 'bb7b534c-6833-4309-9ae2-2313965b1b66', '9c26761e-e4ba-4e8e-b8ae-e2e32eb4a563'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:17.061583 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:17.141944 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:17.233096 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:17.244194 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Acquiring lock "cinder-46ab6b42-669f-4b0d-ba75-da1d55253a35-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:17.269066 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] Deleted volume successfully. Jul 30 21:29:17.315747 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Lock "cinder-46ab6b42-669f-4b0d-ba75-da1d55253a35-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:17.371006 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1e59148c-429e-43d2-8c5c-5e7c8674e157 tempest-VolumesMetadataTest-1109008992 None] Lock "cinder-bd890119-6cdc-4863-a83c-32c26a0ba4b1-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:17.408060 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Performing cascade delete. {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}} Jul 30 21:29:17.429164 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Acquiring lock "cinder-597dffac-b7f2-4abe-90f5-56d668baec57-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:17.441026 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Lock "cinder-597dffac-b7f2-4abe-90f5-56d668baec57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:17.467473 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:18.729043 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Created reservations ['7cd44026-40b4-453b-a891-cbea0da053ae', '1b363c95-d895-49ed-b43a-e2063908b605', '4c970282-90ac-4575-bec4-80d61f9d0a8b', 'b455c758-655f-4b16-a2df-53047f84c5b4'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:18.762095 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=60,cinder:INSERT=6,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:18.866103 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Delete snapshot completed successfully. Jul 30 21:29:18.873688 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Lock "cinder-597dffac-b7f2-4abe-90f5-56d668baec57-delete_snapshot" released by "delete_snapshot" :: held 1.433s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:18.875028 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Acquiring lock "cinder-c98fb0d8-3e63-4863-9ec4-37317e898983-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:18.896123 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Lock "cinder-c98fb0d8-3e63-4863-9ec4-37317e898983-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:18.939723 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:19.810395 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=26,cinder:SELECT=66,cinder:DELETE=4,cinder:INSERT=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:19.837146 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Created reservations ['9c528a6e-e6c4-4b22-86d5-029c89d3c58f', '9eb3a3f8-c42d-45ac-afdd-19daff195441', '92f5f57b-69c0-457a-af83-f5ea948c5ea6', '5a979400-bbbb-43b4-bb56-79e7a84bc0e3'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:19.946134 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Delete snapshot completed successfully. Jul 30 21:29:19.952332 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Lock "cinder-c98fb0d8-3e63-4863-9ec4-37317e898983-delete_snapshot" released by "delete_snapshot" :: held 1.056s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:19.955633 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Snapshots deleted, issuing volume delete {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}} Jul 30 21:29:19.957474 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:20.064502 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:20.064502 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Volume volume-46ab6b42-669f-4b0d-ba75-da1d55253a35 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:20.080347 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] deleting rbd volume volume-46ab6b42-669f-4b0d-ba75-da1d55253a35 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:20.314386 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] Acquiring lock "cinder-85ef6368-9767-491a-a147-537c234ec341-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:20.329958 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] Lock "cinder-85ef6368-9767-491a-a147-537c234ec341-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:20.418416 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:21.358110 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] Volume volume-85ef6368-9767-491a-a147-537c234ec341 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:21.404906 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] deleting rbd volume volume-85ef6368-9767-491a-a147-537c234ec341 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:21.539645 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Created reservations ['a43d3e80-1fd1-4967-bc14-952134fe409b', '1234a2d8-b50e-4292-8d76-d712256a5209', 'f9478210-7d29-404a-bd9d-2e0b83f2c212', '8df370a8-603f-46c7-9d95-4b7b29d2859c'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:21.698437 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:21.800582 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:21.882906 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:21.888188 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Deleted volume successfully. Jul 30 21:29:21.931799 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-82d1bcb8-2a1e-47f2-b111-6f301a0fdd24 tempest-VolumesDeleteCascade-1919992697 None] Lock "cinder-46ab6b42-669f-4b0d-ba75-da1d55253a35-delete_volume" released by "delete_volume" :: held 4.618s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:22.003646 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] Created reservations ['41bd5221-d3f9-4db8-9135-397a027e1ece', '0eeee67c-b04d-4c7e-8751-ec8e3101bbdf', 'b4783845-9e8b-4c3c-9430-0b4a8f8f7a66', '596ce927-7d7a-43c2-8c70-0b28219862bf'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:22.116645 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:22.191269 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:22.263852 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:22.279749 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] Deleted volume successfully. Jul 30 21:29:22.310285 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-50c9abbd-81e8-4d79-9439-7571cf61b362 tempest-VolumesBackupsAdminTest-909892006 None] Lock "cinder-85ef6368-9767-491a-a147-537c234ec341-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:22.315993 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:22.348240 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Flow 'volume_create_manager' (8f959936-544c-4a1e-80bd-895fac8de3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:22.359505 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6224e9e-6d88-46f9-9e03-43d8bc7e3fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:22.383749 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6224e9e-6d88-46f9-9e03-43d8bc7e3fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-873015486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=41f625ff-08f8-4911-95cd-dd76119c16f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d48c99044864b23a7ed248d345ce668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:22Z,use_quota=True,user_id='03f373601d75447ab5c3a3ce308d1f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:22.391402 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e820879-59b9-4fff-a85a-83ba58f2aba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:22.398741 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e820879-59b9-4fff-a85a-83ba58f2aba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:22.407051 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a895cc84-a499-40e5-b744-86af5fc21ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:22.412774 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a895cc84-a499-40e5-b744-86af5fc21ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f625ff-08f8-4911-95cd-dd76119c16f2', 'volume_name': 'volume-41f625ff-08f8-4911-95cd-dd76119c16f2', 'volume_size': 2}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:22.419698 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f3e517-1933-455d-9f37-cb605ebe121a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:22.431883 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f3e517-1933-455d-9f37-cb605ebe121a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:22.443971 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891884e5-63c3-4f7d-bb1a-899a4c9df2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:22.455572 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Volume 41f625ff-08f8-4911-95cd-dd76119c16f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f625ff-08f8-4911-95cd-dd76119c16f2', 'volume_size': 2} Jul 30 21:29:22.455572 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] creating volume 'volume-41f625ff-08f8-4911-95cd-dd76119c16f2' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:22.455572 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:22.616973 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:22.617954 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:22.625131 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891884e5-63c3-4f7d-bb1a-899a4c9df2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f625ff-08f8-4911-95cd-dd76119c16f2', 'volume_size': 2}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:22.633950 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2626654e-eb00-4c82-9d8b-998db8c7f028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:22.672436 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Volume volume-41f625ff-08f8-4911-95cd-dd76119c16f2 (41f625ff-08f8-4911-95cd-dd76119c16f2): created successfully Jul 30 21:29:22.682826 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2626654e-eb00-4c82-9d8b-998db8c7f028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:22.689549 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Flow 'volume_create_manager' (8f959936-544c-4a1e-80bd-895fac8de3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:22.696022 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] Acquiring lock "cinder-9f6948f8-0361-49db-8527-fde062205989-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:22.709866 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] Lock "cinder-9f6948f8-0361-49db-8527-fde062205989-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:22.724915 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5a425f68-f201-4dbd-8118-45cb668719d9 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Created volume successfully. Jul 30 21:29:22.791079 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:23.400627 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] Volume volume-9f6948f8-0361-49db-8527-fde062205989 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:23.421635 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] deleting rbd volume volume-9f6948f8-0361-49db-8527-fde062205989 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:23.707801 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-62ba0dc9-d236-417f-beda-59579bcfd684 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:23.917947 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] Created reservations ['b781a093-65a2-40dc-ad26-5cbc7972de82', 'd97c5fa9-091c-4b5b-9540-65ba969ed5db', '05ecd4ce-5748-4716-9655-7dc44b6dccdf', '98a93319-fe22-4d50-8e73-db445c71e24b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:23.990462 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=53,cinder:INSERT=13,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:24.015578 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:24.098334 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:24.176087 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:24.182206 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] Deleted volume successfully. Jul 30 21:29:24.207942 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fcd89d67-dff0-45e4-aabe-b8af978a8570 tempest-VolumesBackupsAdminTest-909892006 None] Lock "cinder-9f6948f8-0361-49db-8527-fde062205989-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:24.572327 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-62ba0dc9-d236-417f-beda-59579bcfd684 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Create snapshot completed successfully Jul 30 21:29:25.042877 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1e51394a-b511-4c74-84bc-5d401f6211b7 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Acquiring lock "cinder-7260d74b-a6e0-49bb-b238-c1e3caef6494-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:25.077026 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1e51394a-b511-4c74-84bc-5d401f6211b7 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Lock "cinder-7260d74b-a6e0-49bb-b238-c1e3caef6494-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:25.084606 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1e51394a-b511-4c74-84bc-5d401f6211b7 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:26.621756 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-1e51394a-b511-4c74-84bc-5d401f6211b7 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Created reservations ['6fb02e17-0f08-4f6a-970f-43172b6a4953', '92fd0ce7-292a-47a7-939d-0a77073552c2', 'dea22a61-b461-441e-abf2-42005714e3d4', '5d0fd658-9807-4f7e-b86f-a52dc359b05b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:26.719055 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=54,cinder:INSERT=5,cinder:UPDATE=37,cinder:DELETE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:26.729129 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-1e51394a-b511-4c74-84bc-5d401f6211b7 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Delete snapshot completed successfully. Jul 30 21:29:26.748686 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-1e51394a-b511-4c74-84bc-5d401f6211b7 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Lock "cinder-7260d74b-a6e0-49bb-b238-c1e3caef6494-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:27.385760 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Acquiring lock "cinder-41f625ff-08f8-4911-95cd-dd76119c16f2-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:27.418794 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Lock "cinder-41f625ff-08f8-4911-95cd-dd76119c16f2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:27.520549 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:27.659031 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:27.660357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Volume volume-41f625ff-08f8-4911-95cd-dd76119c16f2 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:27.676975 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] deleting rbd volume volume-41f625ff-08f8-4911-95cd-dd76119c16f2 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:28.183527 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Created reservations ['77c1b4cd-5428-47c3-a943-48785ea075fd', '6dcd7aff-9dd5-4e17-8081-44102e6967bd', '13dd9d88-e7f4-4b5f-8afc-df3b30a6f15d', '51258ab8-3bf6-4720-8a82-96e62ffb9e87'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:28.271047 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:28.335420 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:28.420305 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:28.425784 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Deleted volume successfully. Jul 30 21:29:28.466647 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ddc23653-8b91-4e93-a1ab-806feb7e3a00 tempest-VolumesSnapshotNegativeTestJSON-1270834445 None] Lock "cinder-41f625ff-08f8-4911-95cd-dd76119c16f2-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:29.278281 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:29.344624 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Flow 'volume_create_manager' (c2dfe201-faad-47ed-b4e5-a900dcaf2c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:29.363769 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18f250f-6c25-4157-9bd8-d31c2972aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:29.414083 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18f250f-6c25-4157-9bd8-d31c2972aad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-955537359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=81a743f4-e504-45b1-b9d5-e28877481bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7b5de3c9834471a1ff40d046bb102e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:29Z,use_quota=True,user_id='800c2fc6e5114172a6994ca3d1ae0362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:29.427974 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a79ac63-7138-4531-af92-9f5f9613ad25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:29.440846 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a79ac63-7138-4531-af92-9f5f9613ad25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:29.461001 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec00eada-18b9-4625-90f6-807ec709e4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:29.471542 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec00eada-18b9-4625-90f6-807ec709e4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a743f4-e504-45b1-b9d5-e28877481bd0', 'volume_name': 'volume-81a743f4-e504-45b1-b9d5-e28877481bd0', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:29.483418 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd05ac46-0324-440a-8eb9-a045b53550d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:29.491106 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd05ac46-0324-440a-8eb9-a045b53550d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:29.507682 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efda9952-9394-4868-865e-e11a83e3e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:29.509147 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Volume 81a743f4-e504-45b1-b9d5-e28877481bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a743f4-e504-45b1-b9d5-e28877481bd0', 'volume_size': 1} Jul 30 21:29:29.509754 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] creating volume 'volume-81a743f4-e504-45b1-b9d5-e28877481bd0' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:29.512777 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:29.686881 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:29.687155 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:29.691113 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efda9952-9394-4868-865e-e11a83e3e770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a743f4-e504-45b1-b9d5-e28877481bd0', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:29.697253 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3be2708-525c-489a-8a20-c50c93a7319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:29.721481 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Volume volume-81a743f4-e504-45b1-b9d5-e28877481bd0 (81a743f4-e504-45b1-b9d5-e28877481bd0): created successfully Jul 30 21:29:29.725665 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3be2708-525c-489a-8a20-c50c93a7319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:29.741844 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Flow 'volume_create_manager' (c2dfe201-faad-47ed-b4e5-a900dcaf2c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:29.763205 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-10047dfb-2abf-405c-80f0-410f41467e79 tempest-VolumesTransfersTest-893825719 None] Created volume successfully. Jul 30 21:29:31.675951 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-faaf3e8b-581a-4f5c-b1df-01347223d9f4 tempest-VolumesTransfersTest-403083271 None] Transfer volume completed successfully. Jul 30 21:29:33.090054 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] Acquiring lock "cinder-81a743f4-e504-45b1-b9d5-e28877481bd0-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:33.102360 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] Lock "cinder-81a743f4-e504-45b1-b9d5-e28877481bd0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:33.183755 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:33.255707 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:33.256203 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] Volume volume-81a743f4-e504-45b1-b9d5-e28877481bd0 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:33.265343 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] deleting rbd volume volume-81a743f4-e504-45b1-b9d5-e28877481bd0 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:33.788020 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:33.815190 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Flow 'volume_create_manager' (4094d185-f14d-4e57-bb5a-332dcee06fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:33.825462 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83f9d6c-9a99-4629-a1df-e8ae2921d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:33.857580 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83f9d6c-9a99-4629-a1df-e8ae2921d821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1649433399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c7e91259-f4b5-42b4-bfa3-ffddc046177a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f775b36924d4be3b70b97ee36258290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:34Z,use_quota=True,user_id='1493dda08c1c46f693568b9d2cbb6548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:33.865707 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666e688c-f7b8-4e8c-b7e6-8d00adcbef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:33.872141 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666e688c-f7b8-4e8c-b7e6-8d00adcbef63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:33.878918 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b19eac-2170-4ab0-a455-77db9c1f303c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:33.885771 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b19eac-2170-4ab0-a455-77db9c1f303c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e91259-f4b5-42b4-bfa3-ffddc046177a', 'volume_name': 'volume-c7e91259-f4b5-42b4-bfa3-ffddc046177a', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:33.894134 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde09a41-19f1-46fe-823e-ac8c254c69e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:33.900970 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde09a41-19f1-46fe-823e-ac8c254c69e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:33.907042 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2468b8f8-a28c-460a-89df-bdffae9e6de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:33.909050 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Volume c7e91259-f4b5-42b4-bfa3-ffddc046177a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e91259-f4b5-42b4-bfa3-ffddc046177a', 'volume_size': 1} Jul 30 21:29:33.919067 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] creating volume 'volume-c7e91259-f4b5-42b4-bfa3-ffddc046177a' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:33.926698 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:33.988378 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] Created reservations ['452399d9-2e44-4714-9101-261197417ad5', '26692eff-8fd5-4054-adf2-43106cdcadf1', '210fbc4c-989c-49de-a53c-e888fd254bcc', 'f0452f7e-3fbc-4008-9104-83c285713a2d'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:34.083902 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:34.084669 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:34.089523 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2468b8f8-a28c-460a-89df-bdffae9e6de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e91259-f4b5-42b4-bfa3-ffddc046177a', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:34.105826 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d9228f-1d08-4154-852c-2db7dea6232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:34.140008 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Volume volume-c7e91259-f4b5-42b4-bfa3-ffddc046177a (c7e91259-f4b5-42b4-bfa3-ffddc046177a): created successfully Jul 30 21:29:34.144487 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d9228f-1d08-4154-852c-2db7dea6232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:34.156969 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Flow 'volume_create_manager' (4094d185-f14d-4e57-bb5a-332dcee06fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:34.164226 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:34.210402 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:34.257831 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:34.267638 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] Deleted volume successfully. Jul 30 21:29:34.275055 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c9a1511b-9336-4446-a890-ffe9ba31120b tempest-AbsoluteLimitsTests-754682679 None] Created volume successfully. Jul 30 21:29:34.287477 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-ffcfe8fb-b8a8-4c9e-8803-0bf9bc7b2e4f tempest-VolumesTransfersTest-118741453 None] Lock "cinder-81a743f4-e504-45b1-b9d5-e28877481bd0-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:34.782726 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:34.845773 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Flow 'volume_create_manager' (ecfa112e-be81-4571-9b3c-5c2b0b956cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:34.868619 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c98297-919f-42ed-83f9-a0fbb0ce0816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:34.916893 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c98297-919f-42ed-83f9-a0fbb0ce0816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-135063551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0395204c-3dd5-4137-a840-74505b24bacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7b5de3c9834471a1ff40d046bb102e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:35Z,use_quota=True,user_id='800c2fc6e5114172a6994ca3d1ae0362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:34.923777 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c683d9f4-c032-4903-8459-c3d65f0ace00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:34.929353 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c683d9f4-c032-4903-8459-c3d65f0ace00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:34.935821 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65be6372-fb00-4e83-8ed9-1350176785fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:34.940276 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65be6372-fb00-4e83-8ed9-1350176785fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0395204c-3dd5-4137-a840-74505b24bacc', 'volume_name': 'volume-0395204c-3dd5-4137-a840-74505b24bacc', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:34.948411 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cb84e3-3c11-40de-8517-5e814e2748f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:34.953168 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cb84e3-3c11-40de-8517-5e814e2748f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:34.958968 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5113cf21-0f83-4a27-92bb-ac947b2dbaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:34.960570 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Volume 0395204c-3dd5-4137-a840-74505b24bacc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0395204c-3dd5-4137-a840-74505b24bacc', 'volume_size': 1} Jul 30 21:29:34.961185 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] creating volume 'volume-0395204c-3dd5-4137-a840-74505b24bacc' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:34.962031 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:35.028461 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] Acquiring lock "cinder-c7e91259-f4b5-42b4-bfa3-ffddc046177a-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:35.059378 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] Lock "cinder-c7e91259-f4b5-42b4-bfa3-ffddc046177a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:35.074561 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:35.076502 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:35.085055 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5113cf21-0f83-4a27-92bb-ac947b2dbaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0395204c-3dd5-4137-a840-74505b24bacc', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:35.096659 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8601f3e-7404-43a2-a883-3ad6fede8f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:35.121163 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Volume volume-0395204c-3dd5-4137-a840-74505b24bacc (0395204c-3dd5-4137-a840-74505b24bacc): created successfully Jul 30 21:29:35.127327 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8601f3e-7404-43a2-a883-3ad6fede8f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:35.133885 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Flow 'volume_create_manager' (ecfa112e-be81-4571-9b3c-5c2b0b956cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:35.165125 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:35.235017 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:35.236381 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] Volume volume-c7e91259-f4b5-42b4-bfa3-ffddc046177a is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:35.246266 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] deleting rbd volume volume-c7e91259-f4b5-42b4-bfa3-ffddc046177a {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:35.250790 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b8f90e59-a83f-4753-93ac-5828657a611d tempest-VolumesTransfersTest-893825719 None] Created volume successfully. Jul 30 21:29:35.696115 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] Created reservations ['245aab68-00a6-4a32-b2e2-25a5829db1f1', '9118c43b-f21b-42cb-a0aa-685e133f437e', '57c997da-1d7d-4e06-819b-9a8a09a9cad8', '2b9c30d3-e473-44ed-a690-378c75a2f1dd'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:35.793560 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:35.876108 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:35.926391 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:35.932057 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] Deleted volume successfully. Jul 30 21:29:35.952593 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-078d2f06-c2da-4b4d-ace9-71457fcd4871 tempest-AbsoluteLimitsTests-754682679 None] Lock "cinder-c7e91259-f4b5-42b4-bfa3-ffddc046177a-delete_volume" released by "delete_volume" :: held 0.894s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:36.460568 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] Acquiring lock "cinder-0395204c-3dd5-4137-a840-74505b24bacc-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:36.488164 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] Lock "cinder-0395204c-3dd5-4137-a840-74505b24bacc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:36.584314 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:36.696742 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:36.697160 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] Volume volume-0395204c-3dd5-4137-a840-74505b24bacc is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:36.707485 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] deleting rbd volume volume-0395204c-3dd5-4137-a840-74505b24bacc {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:37.115191 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=55,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:37.139825 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=61,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:37.206733 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] Created reservations ['ce1c93f1-fbe0-4d1f-b512-90b9d5525d67', '960738a1-06d4-47d8-a956-fd718a5a410a', '0eeda5e9-5ee6-44d7-bdf9-d88fd1e2dcb7', 'cb42c448-f890-47dc-b974-5c178ca5ed9c'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:37.277501 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:37.355135 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:37.421630 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:37.424228 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] Deleted volume successfully. Jul 30 21:29:37.443670 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a5349214-b9ec-4fdf-adcd-026f2aa22027 tempest-VolumesTransfersTest-118741453 None] Lock "cinder-0395204c-3dd5-4137-a840-74505b24bacc-delete_volume" released by "delete_volume" :: held 0.969s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:43.072146 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:43.107665 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Flow 'volume_create_manager' (977fcf33-d372-4faa-88e7-7a79e34a459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:43.114833 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c278d26f-ee7c-4ccc-bd45-c1b0c45286a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:43.139259 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c278d26f-ee7c-4ccc-bd45-c1b0c45286a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-554958789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3cc8f1d43494d49bdf77a5bdb852f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:43Z,use_quota=True,user_id='c9bb480dc5a14b018f6aab37206aefd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:43.146475 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b81e2b-79e1-4388-be1c-b3489e1023ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:43.151193 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b81e2b-79e1-4388-be1c-b3489e1023ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:43.157837 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1001ff-8e6f-434e-949b-2cf44cbf90aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:43.162865 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1001ff-8e6f-434e-949b-2cf44cbf90aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b', 'volume_name': 'volume-3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b', 'volume_size': 2}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:43.170183 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7c62fd-9439-43d0-b5b1-786efb8bf603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:43.186440 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7c62fd-9439-43d0-b5b1-786efb8bf603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:43.191551 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fed558-9966-400b-841e-a81e71751c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:43.195349 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Volume 3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b', 'volume_size': 2} Jul 30 21:29:43.196128 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] creating volume 'volume-3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:43.197880 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:43.293275 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:43.293856 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:43.301564 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fed558-9966-400b-841e-a81e71751c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b', 'volume_size': 2}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:43.307760 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d6ed3d-189d-4d73-8079-551d14a56a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:43.326186 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Volume volume-3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b (3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b): created successfully Jul 30 21:29:43.333794 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d6ed3d-189d-4d73-8079-551d14a56a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:43.353913 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Flow 'volume_create_manager' (977fcf33-d372-4faa-88e7-7a79e34a459d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:43.373549 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-4d8ee06d-8372-4c87-99b6-88560c5a5405 tempest-VolumesCloneNegativeTest-19638783 None] Created volume successfully. Jul 30 21:29:44.430217 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] Acquiring lock "cinder-3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:44.468119 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] Lock "cinder-3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:44.572581 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:44.673383 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:44.673892 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] Volume volume-3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:44.680987 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] deleting rbd volume volume-3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:45.004005 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] Created reservations ['e9907292-a0a5-4a76-bf39-b6e62c0e8785', '54c61594-0f0e-48a4-9682-e3b0597fc9ea', '5b1d0028-5cda-4203-b84d-2ce7f78adec7', '64e7310a-1f28-4401-aa93-9228d12279f8'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:45.115425 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:45.233292 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:45.301319 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:45.308966 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] Deleted volume successfully. Jul 30 21:29:45.330964 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-884617f8-1e15-4fc6-a834-e4624a6ffa24 tempest-VolumesCloneNegativeTest-19638783 None] Lock "cinder-3f2ebab7-1b96-4892-a9d6-bad01b6b6c4b-delete_volume" released by "delete_volume" :: held 0.861s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:47.873621 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:47.918833 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Flow 'volume_create_manager' (44eb2bef-4151-428e-a0db-a55f2177c805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:47.930729 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3782988a-f00a-4687-960c-3a47aa005d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:47.972869 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3782988a-f00a-4687-960c-3a47aa005d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-414754181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c612cc80-2906-4443-920b-db75b6a0906d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54de09964564ece97be30b205cf8b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:48Z,use_quota=True,user_id='e8caeeaec0d048aca516702d0e7ac0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:48.016405 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc156f1a-bb14-4609-9436-79417cdef1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:48.024858 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc156f1a-bb14-4609-9436-79417cdef1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:48.038345 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429f537d-d916-45df-bb85-501d5cb8df5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:48.042424 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429f537d-d916-45df-bb85-501d5cb8df5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c612cc80-2906-4443-920b-db75b6a0906d', 'volume_name': 'volume-c612cc80-2906-4443-920b-db75b6a0906d', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:48.065965 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930f29fd-429a-420d-8090-b7c4e51baab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:48.076763 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930f29fd-429a-420d-8090-b7c4e51baab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:48.090514 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2ff0ef-557d-41fb-9c46-4b7d27ab34d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:48.091641 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Volume c612cc80-2906-4443-920b-db75b6a0906d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c612cc80-2906-4443-920b-db75b6a0906d', 'volume_size': 1} Jul 30 21:29:48.092032 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] creating volume 'volume-c612cc80-2906-4443-920b-db75b6a0906d' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:48.092778 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:48.244368 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:48.244776 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:48.253780 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2ff0ef-557d-41fb-9c46-4b7d27ab34d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c612cc80-2906-4443-920b-db75b6a0906d', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:48.263087 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f37725-ff04-4a6c-94f7-efadef09e45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:48.272738 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Volume volume-c612cc80-2906-4443-920b-db75b6a0906d (c612cc80-2906-4443-920b-db75b6a0906d): created successfully Jul 30 21:29:48.276966 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f37725-ff04-4a6c-94f7-efadef09e45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:48.284815 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Flow 'volume_create_manager' (44eb2bef-4151-428e-a0db-a55f2177c805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:48.298212 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bce32b9a-ffb8-448e-ad0e-16a383a8bc58 tempest-VolumesTransfersV355Test-1470844716 None] Created volume successfully. Jul 30 21:29:50.032342 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:50.059689 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Flow 'volume_create_manager' (3ffad3bb-e5c8-48f1-9496-c50e9fb33ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:50.068365 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f955475-47c4-49fb-af4f-6f39f8b70461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:50.093266 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f955475-47c4-49fb-af4f-6f39f8b70461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2037468033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8dede722-0ae9-443f-82d9-aa47de279724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2430c3036ed74cea9b3d1a20b61f780e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:50Z,use_quota=True,user_id='87902729a01b4918a07d61589f9c84da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:50.099486 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91f7da4-268a-4bed-b4ec-f8669a6bd6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:50.105102 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91f7da4-268a-4bed-b4ec-f8669a6bd6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:50.110438 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9718f200-ab9d-4908-a833-877e18abcf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:50.115966 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9718f200-ab9d-4908-a833-877e18abcf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dede722-0ae9-443f-82d9-aa47de279724', 'volume_name': 'volume-8dede722-0ae9-443f-82d9-aa47de279724', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:50.123192 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d7e079-be98-49b5-bc00-9d58ea8b4b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:50.128755 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d7e079-be98-49b5-bc00-9d58ea8b4b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:50.134061 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2854c282-1ffb-4e56-9457-910df2fc5550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:50.135971 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Volume 8dede722-0ae9-443f-82d9-aa47de279724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dede722-0ae9-443f-82d9-aa47de279724', 'volume_size': 1} Jul 30 21:29:50.136622 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] creating volume 'volume-8dede722-0ae9-443f-82d9-aa47de279724' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:50.137614 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:50.204758 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3af09752-2329-4ff8-af04-daf9eae0692f tempest-VolumesTransfersV355Test-1686170876 None] Transfer volume completed successfully. Jul 30 21:29:50.225026 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:50.225659 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:50.232906 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2854c282-1ffb-4e56-9457-910df2fc5550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dede722-0ae9-443f-82d9-aa47de279724', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:50.239605 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364bd383-163b-4dd8-aa63-fbc42ba2e4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:50.254569 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Volume volume-8dede722-0ae9-443f-82d9-aa47de279724 (8dede722-0ae9-443f-82d9-aa47de279724): created successfully Jul 30 21:29:50.259810 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364bd383-163b-4dd8-aa63-fbc42ba2e4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:50.267920 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Flow 'volume_create_manager' (3ffad3bb-e5c8-48f1-9496-c50e9fb33ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:50.279967 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3360790a-89dc-41c7-b158-d0a8146730f7 tempest-VolumesNegativeTest-1438286119 None] Created volume successfully. Jul 30 21:29:50.851051 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] Acquiring lock "cinder-c612cc80-2906-4443-920b-db75b6a0906d-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:50.884715 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] Lock "cinder-c612cc80-2906-4443-920b-db75b6a0906d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:50.947607 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:51.051196 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:51.051977 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] Volume volume-c612cc80-2906-4443-920b-db75b6a0906d is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:51.058557 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] deleting rbd volume volume-c612cc80-2906-4443-920b-db75b6a0906d {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:51.460138 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] Created reservations ['a6085f23-9e46-4349-8898-0fc958c7183d', 'b8e590ed-7ffc-44a6-a298-7bbe2ab00909', '3fb866ed-c928-4b31-bfac-8a4f203d9593', '80e43b55-893f-4da6-b871-a252bb546942'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:51.519009 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:51.586986 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:51.652348 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:51.658825 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] Deleted volume successfully. Jul 30 21:29:51.688494 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-197e090f-0225-404a-98ac-978273b9f84d tempest-VolumesTransfersV355Test-2114231231 None] Lock "cinder-c612cc80-2906-4443-920b-db75b6a0906d-delete_volume" released by "delete_volume" :: held 0.804s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:29:52.690973 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:29:52.722968 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Flow 'volume_create_manager' (e1a8f484-f687-4cf7-9102-de10f1d74fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:52.732195 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d3092a-3c7f-42d2-a379-f81ac36e0b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:52.764763 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d3092a-3c7f-42d2-a379-f81ac36e0b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-666191139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54de09964564ece97be30b205cf8b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:29:53Z,use_quota=True,user_id='e8caeeaec0d048aca516702d0e7ac0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:52.771678 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4ee024-e633-4001-829f-10baccb9c98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:52.783253 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4ee024-e633-4001-829f-10baccb9c98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:52.793624 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad050ce-398a-4717-aafd-7cedc86170ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:52.800262 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad050ce-398a-4717-aafd-7cedc86170ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207', 'volume_name': 'volume-f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:52.817087 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9293f53a-8e81-4546-9055-6656ac79f62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:52.825022 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9293f53a-8e81-4546-9055-6656ac79f62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:52.842912 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6491e81-c526-494b-8632-e54e8a79e4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:52.844709 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Volume f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207', 'volume_size': 1} Jul 30 21:29:52.845327 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] creating volume 'volume-f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:29:52.848070 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:52.959677 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:29:52.960304 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:29:52.966572 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6491e81-c526-494b-8632-e54e8a79e4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:52.981409 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b254ac53-cf6d-4158-9f43-c522f765204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:29:53.018226 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Volume volume-f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207 (f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207): created successfully Jul 30 21:29:53.030433 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b254ac53-cf6d-4158-9f43-c522f765204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:29:53.049691 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Flow 'volume_create_manager' (e1a8f484-f687-4cf7-9102-de10f1d74fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:29:53.073544 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-befeee15-4088-446b-a6c7-2c6302151957 tempest-VolumesTransfersV355Test-1470844716 None] Created volume successfully. Jul 30 21:29:54.173702 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] Acquiring lock "cinder-f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:29:54.193052 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] Lock "cinder-f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:29:54.207418 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=53,cinder:INSERT=9,cinder:UPDATE=32,cinder:DELETE=6 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:29:54.276041 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:54.368521 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:29:54.369127 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] Volume volume-f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:29:54.380842 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] deleting rbd volume volume-f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:29:54.727665 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] Created reservations ['1856d69d-8ef2-409b-b27c-c98366263845', 'b03e23e7-303a-4ef3-a440-7743a53cae1a', '24f36dbd-9754-4fdd-b883-7152fa928baa', '27167066-8675-4515-b401-65d6e2a407cc'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:29:54.811911 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:54.863346 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:29:54.912870 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:29:54.923058 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] Deleted volume successfully. Jul 30 21:29:54.938272 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-7ec54e70-4ffe-4e73-b2a0-f8ca7838b661 tempest-VolumesTransfersV355Test-2114231231 None] Lock "cinder-f1e4c4dd-c4ba-4dc8-9be9-3a958ac53207-delete_volume" released by "delete_volume" :: held 0.745s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:03.057757 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=37,cinder:SELECT=56,cinder:INSERT=5,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:03.077285 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:03.134018 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (ef73a965-6565-43fd-b5a0-e86f6339b074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:03.161392 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b122e61-23a2-4048-9375-73aed64ac79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:03.197103 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b122e61-23a2-4048-9375-73aed64ac79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-640915652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9b581c21-fd65-46e0-b3c4-9aac17f39941,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d68db0e8ec2249f198f3d6c01663919d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:03Z,use_quota=True,user_id='7d169e8119cf4c6f877fd2900e941c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:03.239165 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87fc207-8eeb-41a9-8dcd-964afc2a5286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:03.257484 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87fc207-8eeb-41a9-8dcd-964afc2a5286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:03.285178 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a5e7a3-9359-4a95-b424-01afa3d5d457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:03.309953 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a5e7a3-9359-4a95-b424-01afa3d5d457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b581c21-fd65-46e0-b3c4-9aac17f39941', 'volume_name': 'volume-9b581c21-fd65-46e0-b3c4-9aac17f39941', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:03.324754 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfd370f-65cb-4bad-b137-5395a5b20252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:03.334363 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfd370f-65cb-4bad-b137-5395a5b20252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:03.340880 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe96c71-63c6-4a01-be6e-09e50a4f0e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:03.344545 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Volume 9b581c21-fd65-46e0-b3c4-9aac17f39941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b581c21-fd65-46e0-b3c4-9aac17f39941', 'volume_size': 1} Jul 30 21:30:03.346430 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] creating volume 'volume-9b581c21-fd65-46e0-b3c4-9aac17f39941' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:03.364814 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:03.545247 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:03.546117 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:03.552418 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe96c71-63c6-4a01-be6e-09e50a4f0e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b581c21-fd65-46e0-b3c4-9aac17f39941', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:03.560262 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e2bdaa-6df8-4dd3-8b2c-f8ad849cb2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:03.576502 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Volume volume-9b581c21-fd65-46e0-b3c4-9aac17f39941 (9b581c21-fd65-46e0-b3c4-9aac17f39941): created successfully Jul 30 21:30:03.582178 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e2bdaa-6df8-4dd3-8b2c-f8ad849cb2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:03.604431 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (ef73a965-6565-43fd-b5a0-e86f6339b074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:03.621580 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a5f6c6c5-c871-45d9-8c6e-c0c3d7142fca tempest-VolumesGetTest-331796126 None] Created volume successfully. Jul 30 21:30:05.012774 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:05.064060 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (f2ce073a-8908-4c1d-945e-af7f825491e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:05.071182 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f26482-908a-4a75-a689-5c09a5d68e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:05.091903 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f26482-908a-4a75-a689-5c09a5d68e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1391649972',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f2a7726b-ed4d-4eec-84d5-7e2a331b7f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68db0e8ec2249f198f3d6c01663919d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:05Z,use_quota=True,user_id='7d169e8119cf4c6f877fd2900e941c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:05.098662 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791f3b81-36e3-4433-a323-de1c3d38a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:05.104284 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791f3b81-36e3-4433-a323-de1c3d38a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:05.110035 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de60dbd-8b1a-4022-999b-551224b53890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:05.114868 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de60dbd-8b1a-4022-999b-551224b53890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a7726b-ed4d-4eec-84d5-7e2a331b7f75', 'volume_name': 'volume-f2a7726b-ed4d-4eec-84d5-7e2a331b7f75', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:05.122835 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab036a7-aa8c-4319-a51b-3f7a31ced5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:05.129063 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab036a7-aa8c-4319-a51b-3f7a31ced5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:05.134607 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cb3d0c-2a7d-42e9-aafb-31377ae585ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:05.136862 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Volume f2a7726b-ed4d-4eec-84d5-7e2a331b7f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a7726b-ed4d-4eec-84d5-7e2a331b7f75', 'volume_size': 1} Jul 30 21:30:05.137260 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] creating volume 'volume-f2a7726b-ed4d-4eec-84d5-7e2a331b7f75' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:05.138068 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:05.260770 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:05.264183 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:05.271053 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cb3d0c-2a7d-42e9-aafb-31377ae585ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a7726b-ed4d-4eec-84d5-7e2a331b7f75', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:05.286264 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8b6c84-7ba3-4197-b6dc-a339f1494db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:05.313134 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Volume volume-f2a7726b-ed4d-4eec-84d5-7e2a331b7f75 (f2a7726b-ed4d-4eec-84d5-7e2a331b7f75): created successfully Jul 30 21:30:05.319256 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8b6c84-7ba3-4197-b6dc-a339f1494db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:05.335949 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (f2ce073a-8908-4c1d-945e-af7f825491e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:05.373880 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-7ea967ea-39d1-4620-9a49-e9642e8ad07f tempest-VolumesGetTest-331796126 None] Created volume successfully. Jul 30 21:30:06.156277 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] Acquiring lock "cinder-f2a7726b-ed4d-4eec-84d5-7e2a331b7f75-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:06.167648 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] Lock "cinder-f2a7726b-ed4d-4eec-84d5-7e2a331b7f75-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:06.239951 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:06.312253 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:06.313853 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] Volume volume-f2a7726b-ed4d-4eec-84d5-7e2a331b7f75 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:06.326342 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] deleting rbd volume volume-f2a7726b-ed4d-4eec-84d5-7e2a331b7f75 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:06.660221 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] Created reservations ['75d7bc96-85cf-4665-8b02-16d82f551f78', '5d7992b0-0ae0-4b99-a327-8967baee150b', '7ca3f75b-1d08-4125-91df-103cfbe59deb', '32ab4619-e706-449a-897e-4bdde1a554a0'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:06.732661 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:06.837167 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:06.927153 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:06.935147 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] Deleted volume successfully. Jul 30 21:30:06.951906 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8a98c866-fb3c-4654-9c03-c4b5b3a22b15 tempest-VolumesGetTest-331796126 None] Lock "cinder-f2a7726b-ed4d-4eec-84d5-7e2a331b7f75-delete_volume" released by "delete_volume" :: held 0.784s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:07.421991 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] Acquiring lock "cinder-9b581c21-fd65-46e0-b3c4-9aac17f39941-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:07.453539 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] Lock "cinder-9b581c21-fd65-46e0-b3c4-9aac17f39941-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:07.553484 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:07.668034 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:07.668460 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] Volume volume-9b581c21-fd65-46e0-b3c4-9aac17f39941 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:07.678773 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] deleting rbd volume volume-9b581c21-fd65-46e0-b3c4-9aac17f39941 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:08.104770 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] Created reservations ['f65c0c9b-54e0-4b11-8030-46d480410881', '7b791300-a2c5-444c-890c-6e208d70301e', '77a81d1c-55ad-414d-917e-deef3e9b2240', '2c77d01a-4074-4087-898c-eee107c8d32c'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:08.194012 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:08.266796 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:08.336772 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:08.351851 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] Deleted volume successfully. Jul 30 21:30:08.371736 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b50615a6-22c5-4cab-900e-44eadd1b1ab6 tempest-VolumesGetTest-331796126 None] Lock "cinder-9b581c21-fd65-46e0-b3c4-9aac17f39941-delete_volume" released by "delete_volume" :: held 0.920s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:09.274732 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:09.307279 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (a6f62c38-56b2-45dc-a1bf-7d3bc602e911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:09.319660 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b4e181-c13c-41f7-afec-1ef93b943edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:09.356642 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b4e181-c13c-41f7-afec-1ef93b943edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2063123507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68db0e8ec2249f198f3d6c01663919d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:09Z,use_quota=True,user_id='7d169e8119cf4c6f877fd2900e941c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:09.376118 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9201ed-1b9a-40ce-be66-bc88e942189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:09.390412 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9201ed-1b9a-40ce-be66-bc88e942189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:09.412712 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb075aa1-e085-47c1-8663-a8d3e0d2d899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:09.430878 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb075aa1-e085-47c1-8663-a8d3e0d2d899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35', 'volume_name': 'volume-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:09.440453 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3577073-22fd-4153-ba28-86c1a3e50471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:09.469439 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3577073-22fd-4153-ba28-86c1a3e50471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:09.498092 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899bd327-8893-47dd-8bc2-311bd9b209ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:09.500224 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Volume f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35', 'volume_size': 1} Jul 30 21:30:09.502405 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] creating volume 'volume-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:09.506233 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:09.662521 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:09.662847 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:09.667848 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899bd327-8893-47dd-8bc2-311bd9b209ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:09.676948 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ef60bd-99b3-4772-bfa6-1c84316234a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:09.716632 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Volume volume-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35 (f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35): created successfully Jul 30 21:30:09.723901 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ef60bd-99b3-4772-bfa6-1c84316234a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:09.741446 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (a6f62c38-56b2-45dc-a1bf-7d3bc602e911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:09.770082 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0f10984c-40f6-4c0e-960b-dd0f2f9a7664 tempest-VolumesGetTest-331796126 None] Created volume successfully. Jul 30 21:30:11.043186 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:11.092634 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (2e25e2c5-66d4-4f0f-b807-aad2aabeeac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:11.112478 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4ad86c-6d7f-4335-83e1-d38929e9f589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:11.133853 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4ad86c-6d7f-4335-83e1-d38929e9f589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-769809444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e97078cc-1db9-4353-bdf9-772faa1559fe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d68db0e8ec2249f198f3d6c01663919d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:11Z,use_quota=True,user_id='7d169e8119cf4c6f877fd2900e941c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:11.141650 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f79e40-d6ca-453e-8207-37d1f079a1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:11.149246 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f79e40-d6ca-453e-8207-37d1f079a1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:11.157010 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f0c2d5-ff25-4b13-bf87-38995af5c8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:11.202612 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f0c2d5-ff25-4b13-bf87-38995af5c8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e97078cc-1db9-4353-bdf9-772faa1559fe', 'volume_name': 'volume-e97078cc-1db9-4353-bdf9-772faa1559fe', 'volume_size': 1, 'source_volid': 'f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35', 'source_volstatus': 'available'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:11.209545 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6335014-6633-46c5-acb1-0aa0001fa287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:11.221871 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6335014-6633-46c5-acb1-0aa0001fa287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:11.227157 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fdb72a-5e2c-4ca3-90da-b89ceadcf2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:11.228358 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Volume e97078cc-1db9-4353-bdf9-772faa1559fe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e97078cc-1db9-4353-bdf9-772faa1559fe', 'volume_size': 1, 'source_volid': 'f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35', 'source_volstatus': 'available'} Jul 30 21:30:11.241857 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:11.334994 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] creating snapshot='volume-e97078cc-1db9-4353-bdf9-772faa1559fe.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:30:11.573326 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] cloning 'volume-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35@volume-e97078cc-1db9-4353-bdf9-772faa1559fe.clone_snap' to 'volume-e97078cc-1db9-4353-bdf9-772faa1559fe' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:30:11.706586 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Volume volume-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:11.708699 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:11.709073 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:11.747665 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:30:11.752722 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fdb72a-5e2c-4ca3-90da-b89ceadcf2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97078cc-1db9-4353-bdf9-772faa1559fe', 'volume_size': 1, 'source_volid': 'f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35', 'source_volstatus': 'available'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:11.757923 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4376e864-863d-415f-9bdd-e41117150d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:11.769109 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Volume volume-e97078cc-1db9-4353-bdf9-772faa1559fe (e97078cc-1db9-4353-bdf9-772faa1559fe): created successfully Jul 30 21:30:11.776231 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4376e864-863d-415f-9bdd-e41117150d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:11.782857 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (2e25e2c5-66d4-4f0f-b807-aad2aabeeac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:11.809910 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-77b18e23-b9a1-42a6-bb53-95b7cb417ffd tempest-VolumesGetTest-331796126 None] Created volume successfully. Jul 30 21:30:13.038319 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:13.064122 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (14b577d1-92b7-4044-9a43-c771a1d17954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:13.071124 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90222efc-5097-4f6b-8abf-5dc2b2cb5633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:13.091862 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90222efc-5097-4f6b-8abf-5dc2b2cb5633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-999467545',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=74d57921-7aa4-48dd-a3f8-d15558e1122a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68db0e8ec2249f198f3d6c01663919d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:13Z,use_quota=True,user_id='7d169e8119cf4c6f877fd2900e941c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:13.098723 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1260bec4-73af-48db-922a-a840a88db158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:13.103995 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1260bec4-73af-48db-922a-a840a88db158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:13.110147 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711ba38d-ac5f-4a9d-91df-2f24de4de76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:13.114344 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711ba38d-ac5f-4a9d-91df-2f24de4de76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d57921-7aa4-48dd-a3f8-d15558e1122a', 'volume_name': 'volume-74d57921-7aa4-48dd-a3f8-d15558e1122a', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:13.119959 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb16f1e-ec8f-428d-8255-f319e11cdb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:13.123774 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb16f1e-ec8f-428d-8255-f319e11cdb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:13.129648 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88f6095-2f15-4006-a5ee-a2318aa116bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:13.131100 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Volume 74d57921-7aa4-48dd-a3f8-d15558e1122a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d57921-7aa4-48dd-a3f8-d15558e1122a', 'volume_size': 1} Jul 30 21:30:13.131605 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] creating volume 'volume-74d57921-7aa4-48dd-a3f8-d15558e1122a' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:13.132840 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:13.237176 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:13.237699 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:13.242230 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88f6095-2f15-4006-a5ee-a2318aa116bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d57921-7aa4-48dd-a3f8-d15558e1122a', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:13.248267 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd6bd9c-9f8d-4235-a85a-9e58f9228bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:13.262457 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Volume volume-74d57921-7aa4-48dd-a3f8-d15558e1122a (74d57921-7aa4-48dd-a3f8-d15558e1122a): created successfully Jul 30 21:30:13.268746 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd6bd9c-9f8d-4235-a85a-9e58f9228bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:13.280984 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (14b577d1-92b7-4044-9a43-c771a1d17954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:13.295423 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-199fc503-cf0c-47f8-9c15-3eb47008a2fd tempest-VolumesGetTest-331796126 None] Created volume successfully. Jul 30 21:30:14.338585 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:14.366448 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Flow 'volume_create_manager' (035eb277-7b98-4530-bebf-c606a25774da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:14.373696 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74eaa3ae-c7f6-4ece-b41c-e42a1f2b9a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:14.394436 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74eaa3ae-c7f6-4ece-b41c-e42a1f2b9a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-474001700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5259eece-a7b8-4d82-841f-c2929c3d99cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9506d774214db0b17e156ddb712435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:14Z,use_quota=True,user_id='62a906ba21fb4dd9804bcb4c85b44da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:14.400038 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606afa86-78ee-4b3d-aee0-e617e0ed513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:14.404950 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606afa86-78ee-4b3d-aee0-e617e0ed513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:14.411358 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e3c1c5-c095-4229-b86f-f35796c1ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:14.557661 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e3c1c5-c095-4229-b86f-f35796c1ab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5259eece-a7b8-4d82-841f-c2929c3d99cb', 'volume_name': 'volume-5259eece-a7b8-4d82-841f-c2929c3d99cb', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:14.562762 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e860a96-5802-408c-a980-6b02db7f91b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:14.566656 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e860a96-5802-408c-a980-6b02db7f91b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:14.583634 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80468d5f-a9a9-43d8-bd9f-85110fd28123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:14.587429 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Volume 5259eece-a7b8-4d82-841f-c2929c3d99cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5259eece-a7b8-4d82-841f-c2929c3d99cb', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:30:14.589141 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Cloning 5259eece-a7b8-4d82-841f-c2929c3d99cb from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:30:14.590175 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:14.606011 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:14.620698 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 30, 14, 611710)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:30:14.621973 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:30:14.622726 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:30:14.630679 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:14.632899 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:30:14.641091 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 30, 14, 638108)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:30:14.642177 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:30:14.642838 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:30:14.660301 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=66,cinder:INSERT=5,cinder:UPDATE=25,cinder:DELETE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:14.674720 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:14.804166 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] creating snapshot='volume-5259eece-a7b8-4d82-841f-c2929c3d99cb.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:30:15.634843 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-5259eece-a7b8-4d82-841f-c2929c3d99cb.clone_snap' to 'volume-5259eece-a7b8-4d82-841f-c2929c3d99cb' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:30:15.640996 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] Acquiring lock "cinder-74d57921-7aa4-48dd-a3f8-d15558e1122a-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:15.693608 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] Lock "cinder-74d57921-7aa4-48dd-a3f8-d15558e1122a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:15.699549 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=56,cinder:UPDATE=36,cinder:INSERT=5,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:15.707212 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:15.735034 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Flow 'volume_create_manager' (48f874d7-40b1-48df-99f6-cbe20f2f7746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:15.746416 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2413cf-912f-468c-93f2-8ccc534b21a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:15.819740 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2413cf-912f-468c-93f2-8ccc534b21a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1089809902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5b49f79f-6c63-48e6-970b-1a3e28419f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa55292536246a38655d3f6fb016d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:15Z,use_quota=True,user_id='1be151c3a6eb414dbac1203bb0544c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:15.848811 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861afcdf-ca80-4fd8-bc10-70a8938b316d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:15.857866 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861afcdf-ca80-4fd8-bc10-70a8938b316d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:15.866929 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726c4e1c-7a4b-4030-a5e0-d1b3c80ecd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:15.873631 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726c4e1c-7a4b-4030-a5e0-d1b3c80ecd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b49f79f-6c63-48e6-970b-1a3e28419f80', 'volume_name': 'volume-5b49f79f-6c63-48e6-970b-1a3e28419f80', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:15.883020 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e14dfd8-d763-47bd-bd8a-49871675506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:15.887179 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e14dfd8-d763-47bd-bd8a-49871675506c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:15.892085 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb43f5bc-1c5c-4052-a2df-77ee06dd1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:15.893388 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Volume 5b49f79f-6c63-48e6-970b-1a3e28419f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b49f79f-6c63-48e6-970b-1a3e28419f80', 'volume_size': 1} Jul 30 21:30:15.893874 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] creating volume 'volume-5b49f79f-6c63-48e6-970b-1a3e28419f80' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:15.894706 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:16.018444 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:16.020219 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:16.020605 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:16.044016 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:30:16.045053 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Marking volume 5259eece-a7b8-4d82-841f-c2929c3d99cb as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:30:16.070297 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:30:16.071251 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:16.125414 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:16.188585 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:16.216378 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:16.216747 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:16.228437 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb43f5bc-1c5c-4052-a2df-77ee06dd1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b49f79f-6c63-48e6-970b-1a3e28419f80', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:16.238258 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54051502-9cb5-4157-99a9-4fb34b944cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:16.272534 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to 5259eece-a7b8-4d82-841f-c2929c3d99cb. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:30:16.272756 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Creating volume glance metadata for volume 5259eece-a7b8-4d82-841f-c2929c3d99cb backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:30:16.291373 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Volume volume-5b49f79f-6c63-48e6-970b-1a3e28419f80 (5b49f79f-6c63-48e6-970b-1a3e28419f80): created successfully Jul 30 21:30:16.295131 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54051502-9cb5-4157-99a9-4fb34b944cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:16.302759 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Flow 'volume_create_manager' (48f874d7-40b1-48df-99f6-cbe20f2f7746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:16.320539 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f63136b5-bafe-43b3-98f4-05826703d3f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Created volume successfully. Jul 30 21:30:16.326682 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:16.380779 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:16.381468 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] Volume volume-74d57921-7aa4-48dd-a3f8-d15558e1122a is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:16.390021 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] deleting rbd volume volume-74d57921-7aa4-48dd-a3f8-d15558e1122a {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:16.516267 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80468d5f-a9a9-43d8-bd9f-85110fd28123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5259eece-a7b8-4d82-841f-c2929c3d99cb', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:16.528452 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d6342-e8f6-4cb0-b9a1-42003bb8f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:16.551715 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Volume volume-5259eece-a7b8-4d82-841f-c2929c3d99cb (5259eece-a7b8-4d82-841f-c2929c3d99cb): created successfully Jul 30 21:30:16.560380 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d6342-e8f6-4cb0-b9a1-42003bb8f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:16.572701 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Flow 'volume_create_manager' (035eb277-7b98-4530-bebf-c606a25774da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:16.589015 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bbc0b7ea-1a24-4388-824f-49606f1a8bd8 tempest-VolumesCloneTest-1500773550 None] Created volume successfully. Jul 30 21:30:16.691649 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] Created reservations ['b3161546-a49b-46c5-aeb5-873eff797fa0', '3a279b51-b68a-46ce-911c-bde2b80c0aff', '103aa2e6-3f4d-40b0-a9ba-1d33c8b7a6cc', '962d299a-4076-4aee-8c8e-2f26a7663b01'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:16.701805 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] Acquiring lock "cinder-8dede722-0ae9-443f-82d9-aa47de279724-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:16.722162 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] Lock "cinder-8dede722-0ae9-443f-82d9-aa47de279724-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:16.774036 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:16.816831 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:16.817203 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] Volume volume-8dede722-0ae9-443f-82d9-aa47de279724 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:16.821194 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] deleting rbd volume volume-8dede722-0ae9-443f-82d9-aa47de279724 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:16.830405 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:16.865162 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:16.899946 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:16.904330 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] Deleted volume successfully. Jul 30 21:30:16.918306 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6329ad58-4ae7-413e-9525-54fa6fff2804 tempest-VolumesGetTest-331796126 None] Lock "cinder-74d57921-7aa4-48dd-a3f8-d15558e1122a-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:17.021247 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] Acquiring lock "cinder-e97078cc-1db9-4353-bdf9-772faa1559fe-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:17.030086 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] Created reservations ['ce69527f-9bc3-4c00-8cec-1723dc04ba13', '20d420c4-d5b6-4b6a-9a44-33da76b471b5', 'd0f4b187-21e4-40a4-8573-fa6dd35cf9bc', '44a57c2b-46dc-4ea2-a413-0c7d0091f75a'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:17.033890 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] Lock "cinder-e97078cc-1db9-4353-bdf9-772faa1559fe-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:17.086423 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:17.138413 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:17.143299 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] deleting rbd volume volume-e97078cc-1db9-4353-bdf9-772faa1559fe {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:17.156241 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:17.182045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:17.210084 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:17.214594 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] Deleted volume successfully. Jul 30 21:30:17.227639 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-e40a6601-a1e8-4598-93e0-365ffccfb978 tempest-VolumesNegativeTest-1438286119 None] Lock "cinder-8dede722-0ae9-443f-82d9-aa47de279724-delete_volume" released by "delete_volume" :: held 0.505s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:17.304812 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:30:17.330602 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] Volume volume-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:17.331133 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] deleting parent snapshot volume-e97078cc-1db9-4353-bdf9-772faa1559fe.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:30:17.704403 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5c06d491-c8c7-4070-adeb-ee193b8537da tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:17.782543 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] Created reservations ['012f74d4-c3fa-455f-96c9-8ec194c79402', '5b158e56-7aec-4a2b-a16e-2afba5eaec1b', '68e94935-5892-4a11-b746-35b6d3ed2256', '059257b6-bdde-45a4-bacc-fe7c32ffe8ea'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:17.863089 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:17.926657 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:17.986763 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:17.991395 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] Deleted volume successfully. Jul 30 21:30:18.013317 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0ff8979b-4651-4056-ab78-f4a081326395 tempest-VolumesGetTest-331796126 None] Lock "cinder-e97078cc-1db9-4353-bdf9-772faa1559fe-delete_volume" released by "delete_volume" :: held 0.979s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:18.054329 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:18.093734 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Flow 'volume_create_manager' (f29538b9-407a-489f-b735-e703cbce72cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:18.106488 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497ba221-db45-4043-b3c3-37d1c16ed755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:18.112096 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=49,cinder:UPDATE=32,cinder:INSERT=15,cinder:DELETE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:18.136660 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497ba221-db45-4043-b3c3-37d1c16ed755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-905549887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3a92e20b-5bf7-449a-8b51-5da374eb0f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9506d774214db0b17e156ddb712435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5259eece-a7b8-4d82-841f-c2929c3d99cb,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:18Z,use_quota=True,user_id='62a906ba21fb4dd9804bcb4c85b44da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:18.151458 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a8727d-8998-4f6f-be67-f8a9931c8925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:18.157751 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a8727d-8998-4f6f-be67-f8a9931c8925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:18.166004 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98f155e-6e92-405f-95aa-9f32b50ef8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:18.199124 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98f155e-6e92-405f-95aa-9f32b50ef8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3a92e20b-5bf7-449a-8b51-5da374eb0f44', 'volume_name': 'volume-3a92e20b-5bf7-449a-8b51-5da374eb0f44', 'volume_size': 1, 'source_volid': '5259eece-a7b8-4d82-841f-c2929c3d99cb', 'source_volstatus': 'available'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:18.210523 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531a300d-9d00-48ce-8731-ac1e9ed1d922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:18.216179 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531a300d-9d00-48ce-8731-ac1e9ed1d922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:18.220510 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5f63ca-3a23-4d93-a8b2-cf59e79422ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:18.221717 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Volume 3a92e20b-5bf7-449a-8b51-5da374eb0f44: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3a92e20b-5bf7-449a-8b51-5da374eb0f44', 'volume_size': 1, 'source_volid': '5259eece-a7b8-4d82-841f-c2929c3d99cb', 'source_volstatus': 'available'} Jul 30 21:30:18.244889 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:18.348309 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] creating snapshot='volume-3a92e20b-5bf7-449a-8b51-5da374eb0f44.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:30:18.703701 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] cloning 'volume-5259eece-a7b8-4d82-841f-c2929c3d99cb@volume-3a92e20b-5bf7-449a-8b51-5da374eb0f44.clone_snap' to 'volume-3a92e20b-5bf7-449a-8b51-5da374eb0f44' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:30:18.727808 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:18.747767 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (421769bb-9be8-42cd-9758-f32930e5d861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:18.754884 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f62f9ec-de36-4ba4-840f-b7af5e16f00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:18.784245 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f62f9ec-de36-4ba4-840f-b7af5e16f00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1660346390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a5af8298-472d-46d2-a4d0-8db5ff19fb1e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d68db0e8ec2249f198f3d6c01663919d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:19Z,use_quota=True,user_id='7d169e8119cf4c6f877fd2900e941c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:18.789398 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d9d2eb-9857-40a5-91e7-2db1d38e5476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:18.793995 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d9d2eb-9857-40a5-91e7-2db1d38e5476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:18.798895 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd6351f-dbd1-4e93-b68e-c7ec9a5df21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:18.819636 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5c06d491-c8c7-4070-adeb-ee193b8537da tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Create snapshot completed successfully Jul 30 21:30:18.823144 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=66,cinder:INSERT=9,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:18.937835 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:18.939501 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:18.939887 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:18.958806 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:30:18.959426 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Marking volume 3a92e20b-5bf7-449a-8b51-5da374eb0f44 as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:30:18.982079 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Copying metadata from source volume 5259eece-a7b8-4d82-841f-c2929c3d99cb to 3a92e20b-5bf7-449a-8b51-5da374eb0f44. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}} Jul 30 21:30:19.034924 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd6351f-dbd1-4e93-b68e-c7ec9a5df21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5af8298-472d-46d2-a4d0-8db5ff19fb1e', 'volume_name': 'volume-a5af8298-472d-46d2-a4d0-8db5ff19fb1e', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:19.039984 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a70922c-80a0-4869-b568-882085fddb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:19.045741 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a70922c-80a0-4869-b568-882085fddb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:19.051712 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659e3934-af12-4d25-baa7-a3a7c25cb1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:19.051953 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Volume a5af8298-472d-46d2-a4d0-8db5ff19fb1e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5af8298-472d-46d2-a4d0-8db5ff19fb1e', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:30:19.052591 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Cloning a5af8298-472d-46d2-a4d0-8db5ff19fb1e from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:30:19.053381 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:19.065686 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5f63ca-3a23-4d93-a8b2-cf59e79422ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a92e20b-5bf7-449a-8b51-5da374eb0f44', 'volume_size': 1, 'source_volid': '5259eece-a7b8-4d82-841f-c2929c3d99cb', 'source_volstatus': 'available'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:19.070318 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc190db-4685-4471-85e1-6dbafad66d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:19.075282 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:19.083154 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Volume volume-3a92e20b-5bf7-449a-8b51-5da374eb0f44 (3a92e20b-5bf7-449a-8b51-5da374eb0f44): created successfully Jul 30 21:30:19.086675 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc190db-4685-4471-85e1-6dbafad66d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:19.092613 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Flow 'volume_create_manager' (f29538b9-407a-489f-b735-e703cbce72cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:19.095478 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 30, 19, 79806)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:30:19.095896 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:30:19.096293 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:30:19.106792 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.030s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:19.106792 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:30:19.110994 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-7e3965e3-7c1b-484b-bb19-f1fe0bc0e787 tempest-VolumesCloneTest-1500773550 None] Created volume successfully. Jul 30 21:30:19.115221 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 30, 19, 109582)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:30:19.115734 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:30:19.116087 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:30:19.129795 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:19.182013 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] creating snapshot='volume-a5af8298-472d-46d2-a4d0-8db5ff19fb1e.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:30:19.704903 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-a5af8298-472d-46d2-a4d0-8db5ff19fb1e.clone_snap' to 'volume-a5af8298-472d-46d2-a4d0-8db5ff19fb1e' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:30:19.866045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:19.868173 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:19.869246 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:19.891158 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:30:19.892036 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Marking volume a5af8298-472d-46d2-a4d0-8db5ff19fb1e as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:30:19.902018 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to a5af8298-472d-46d2-a4d0-8db5ff19fb1e. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:30:19.902682 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Creating volume glance metadata for volume a5af8298-472d-46d2-a4d0-8db5ff19fb1e backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:30:19.968755 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659e3934-af12-4d25-baa7-a3a7c25cb1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5af8298-472d-46d2-a4d0-8db5ff19fb1e', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:19.973597 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41657594-6368-4e14-9a98-f9b28b335312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:19.985921 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Volume volume-a5af8298-472d-46d2-a4d0-8db5ff19fb1e (a5af8298-472d-46d2-a4d0-8db5ff19fb1e): created successfully Jul 30 21:30:19.991663 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41657594-6368-4e14-9a98-f9b28b335312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:19.999525 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (421769bb-9be8-42cd-9758-f32930e5d861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:20.012012 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-fa334f86-d07c-43ca-a135-1d06c547699a tempest-VolumesGetTest-331796126 None] Created volume successfully. Jul 30 21:30:20.072016 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-dd3ad76c-7701-4442-92ff-2077ee121941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Acquiring lock "cinder-1f06ee61-1a7b-4bfa-ab06-48849ba8eb32-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:20.086495 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-dd3ad76c-7701-4442-92ff-2077ee121941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Lock "cinder-1f06ee61-1a7b-4bfa-ab06-48849ba8eb32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:20.088095 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-dd3ad76c-7701-4442-92ff-2077ee121941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:20.581611 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:20.603876 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Flow 'volume_create_manager' (4746b784-93e7-4d34-95ae-069f3ca9cdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:20.610904 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cae9272-40f0-4eb5-a0b0-ffe89a320eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:20.626949 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cae9272-40f0-4eb5-a0b0-ffe89a320eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1469083521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9922ce88-0793-4e58-b493-17f44599a857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9506d774214db0b17e156ddb712435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:21Z,use_quota=True,user_id='62a906ba21fb4dd9804bcb4c85b44da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:20.632437 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0400776e-c592-410b-b153-73b61770a206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:20.637001 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0400776e-c592-410b-b153-73b61770a206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:20.642036 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27341afa-2f1b-42ec-a967-1a0205fe8997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:20.645986 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27341afa-2f1b-42ec-a967-1a0205fe8997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9922ce88-0793-4e58-b493-17f44599a857', 'volume_name': 'volume-9922ce88-0793-4e58-b493-17f44599a857', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:20.651337 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3400e55d-8fb5-4979-a601-98d98f62aa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:20.655633 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3400e55d-8fb5-4979-a601-98d98f62aa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:20.660359 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caeadda4-bccd-4c6c-a85d-630623816b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:20.661431 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Volume 9922ce88-0793-4e58-b493-17f44599a857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9922ce88-0793-4e58-b493-17f44599a857', 'volume_size': 1} Jul 30 21:30:20.661827 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] creating volume 'volume-9922ce88-0793-4e58-b493-17f44599a857' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:20.662589 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:20.735214 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:20.735856 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:20.740824 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caeadda4-bccd-4c6c-a85d-630623816b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9922ce88-0793-4e58-b493-17f44599a857', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:20.746413 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20416582-0d40-4416-82a4-ff71703b7a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:20.763008 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Volume volume-9922ce88-0793-4e58-b493-17f44599a857 (9922ce88-0793-4e58-b493-17f44599a857): created successfully Jul 30 21:30:20.766695 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20416582-0d40-4416-82a4-ff71703b7a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:20.771928 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Flow 'volume_create_manager' (4746b784-93e7-4d34-95ae-069f3ca9cdeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:20.782188 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-91d5082a-2e8d-4118-bf23-14e28d61e593 tempest-VolumesCloneTest-1500773550 None] Created volume successfully. Jul 30 21:30:20.814621 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-dd3ad76c-7701-4442-92ff-2077ee121941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Created reservations ['711303dc-5381-4879-acb5-7afda8bb3a09', '9951993e-fafb-4332-80f7-bfaa746fce4d', '0aa56dc7-344b-4264-8087-5c1c043707b5', 'f51c9b8d-f28b-45ed-841d-51579fabbc98'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:20.861695 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-dd3ad76c-7701-4442-92ff-2077ee121941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Delete snapshot completed successfully. Jul 30 21:30:20.867235 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-dd3ad76c-7701-4442-92ff-2077ee121941 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Lock "cinder-1f06ee61-1a7b-4bfa-ab06-48849ba8eb32-delete_snapshot" released by "delete_snapshot" :: held 0.781s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:21.233184 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Acquiring lock "cinder-5b49f79f-6c63-48e6-970b-1a3e28419f80-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:21.246702 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Lock "cinder-5b49f79f-6c63-48e6-970b-1a3e28419f80-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:21.306755 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:21.357099 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:21.357596 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Volume volume-5b49f79f-6c63-48e6-970b-1a3e28419f80 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:21.366993 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] deleting rbd volume volume-5b49f79f-6c63-48e6-970b-1a3e28419f80 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:21.561145 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:21.586754 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (993beff7-08bb-4d40-9963-23076db8bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:21.593662 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c189b3b-97ad-4424-9bae-99bcd9c2919f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:21.619873 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c189b3b-97ad-4424-9bae-99bcd9c2919f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-807532042',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7fc7820f-4b3d-42c5-8c75-d6246fea4c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68db0e8ec2249f198f3d6c01663919d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:22Z,use_quota=True,user_id='7d169e8119cf4c6f877fd2900e941c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:21.627179 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22735251-3756-4d0f-bc0e-6dc03f13da81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:21.632003 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22735251-3756-4d0f-bc0e-6dc03f13da81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:21.638477 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d28946-9a11-49b6-b6ca-33057d02cc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:21.643212 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d28946-9a11-49b6-b6ca-33057d02cc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc7820f-4b3d-42c5-8c75-d6246fea4c93', 'volume_name': 'volume-7fc7820f-4b3d-42c5-8c75-d6246fea4c93', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:21.648472 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30c091d-61fe-47c2-84bd-4a14c2ab873b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:21.653375 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30c091d-61fe-47c2-84bd-4a14c2ab873b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:21.658070 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e36cbc-ac9a-4d39-9e22-de9d7a94d9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:21.659227 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Volume 7fc7820f-4b3d-42c5-8c75-d6246fea4c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc7820f-4b3d-42c5-8c75-d6246fea4c93', 'volume_size': 1} Jul 30 21:30:21.659738 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] creating volume 'volume-7fc7820f-4b3d-42c5-8c75-d6246fea4c93' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:21.660894 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:21.727065 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:21.727550 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:21.732056 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e36cbc-ac9a-4d39-9e22-de9d7a94d9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc7820f-4b3d-42c5-8c75-d6246fea4c93', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:21.736902 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc69baa-3344-4cdb-940e-55cae86527ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:21.754150 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Volume volume-7fc7820f-4b3d-42c5-8c75-d6246fea4c93 (7fc7820f-4b3d-42c5-8c75-d6246fea4c93): created successfully Jul 30 21:30:21.758689 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc69baa-3344-4cdb-940e-55cae86527ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:21.764651 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Flow 'volume_create_manager' (993beff7-08bb-4d40-9963-23076db8bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:21.777778 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-1ec0d6c9-5ffa-4a95-8cfc-4f035f7abde6 tempest-VolumesGetTest-331796126 None] Created volume successfully. Jul 30 21:30:21.782280 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Created reservations ['7c4085fc-4ea3-4af2-b89a-0144c2ae1c10', 'c1beb69a-6ede-46fe-82a7-06151278eda6', '2fce9577-bc69-4fa6-a29b-c78c4ee307f1', 'efdd9322-49d0-48ae-92de-4d4f8d014227'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:21.830700 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:21.877124 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:21.931902 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:21.937251 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Deleted volume successfully. Jul 30 21:30:21.956783 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-25bb573c-3c69-4647-8708-07b5ae4d7d63 tempest-VolumeSnapshotQuotasNegativeTestJSON-1802971460 None] Lock "cinder-5b49f79f-6c63-48e6-970b-1a3e28419f80-delete_volume" released by "delete_volume" :: held 0.710s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:22.036075 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:22.071172 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Flow 'volume_create_manager' (567f7277-6f55-41d7-9a03-fe9f2b8ac912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:22.078779 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b69ca7-67bc-4c85-9763-c078b2997afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:22.097173 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b69ca7-67bc-4c85-9763-c078b2997afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1975162297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3303c0e9-1cca-45a0-8cb5-834368b7cf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9506d774214db0b17e156ddb712435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9922ce88-0793-4e58-b493-17f44599a857,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:22Z,use_quota=True,user_id='62a906ba21fb4dd9804bcb4c85b44da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:22.102571 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ac22b4-28de-4d02-933d-6a8f1a4827c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:22.106760 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ac22b4-28de-4d02-933d-6a8f1a4827c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:22.111955 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e26a05c-cf8e-45cb-8095-3b4b2fc6f047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:22.128732 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e26a05c-cf8e-45cb-8095-3b4b2fc6f047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3303c0e9-1cca-45a0-8cb5-834368b7cf17', 'volume_name': 'volume-3303c0e9-1cca-45a0-8cb5-834368b7cf17', 'volume_size': 2, 'source_volid': '9922ce88-0793-4e58-b493-17f44599a857', 'source_volstatus': 'available'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:22.133938 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229f14fd-c366-482c-9c09-e0d90ff452d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:22.138773 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229f14fd-c366-482c-9c09-e0d90ff452d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:22.143719 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500b7c0c-9fd1-4769-8452-608015835b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:22.144844 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Volume 3303c0e9-1cca-45a0-8cb5-834368b7cf17: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3303c0e9-1cca-45a0-8cb5-834368b7cf17', 'volume_size': 2, 'source_volid': '9922ce88-0793-4e58-b493-17f44599a857', 'source_volstatus': 'available'} Jul 30 21:30:22.160182 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:22.248088 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] creating snapshot='volume-3303c0e9-1cca-45a0-8cb5-834368b7cf17.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:30:22.764477 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] cloning 'volume-9922ce88-0793-4e58-b493-17f44599a857@volume-3303c0e9-1cca-45a0-8cb5-834368b7cf17.clone_snap' to 'volume-3303c0e9-1cca-45a0-8cb5-834368b7cf17' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:30:22.769239 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] Acquiring lock "cinder-7fc7820f-4b3d-42c5-8c75-d6246fea4c93-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:22.780016 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] Lock "cinder-7fc7820f-4b3d-42c5-8c75-d6246fea4c93-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:22.817999 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=60,cinder:UPDATE=21,cinder:INSERT=15,cinder:DELETE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:22.829406 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:22.890099 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:22.890099 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] Volume volume-7fc7820f-4b3d-42c5-8c75-d6246fea4c93 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:22.896269 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] deleting rbd volume volume-7fc7820f-4b3d-42c5-8c75-d6246fea4c93 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:22.920264 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Volume volume-9922ce88-0793-4e58-b493-17f44599a857 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:22.921562 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:22.922036 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:22.944827 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] resize volume 'volume-3303c0e9-1cca-45a0-8cb5-834368b7cf17' from 1 to 2 {{(pid=124008) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:745}} Jul 30 21:30:22.945531 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:23.148937 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:30:23.153619 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500b7c0c-9fd1-4769-8452-608015835b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3303c0e9-1cca-45a0-8cb5-834368b7cf17', 'volume_size': 2, 'source_volid': '9922ce88-0793-4e58-b493-17f44599a857', 'source_volstatus': 'available'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:23.160141 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443a6b57-0d93-48ab-b013-934f8ea06d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:23.172054 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Volume volume-3303c0e9-1cca-45a0-8cb5-834368b7cf17 (3303c0e9-1cca-45a0-8cb5-834368b7cf17): created successfully Jul 30 21:30:23.177234 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443a6b57-0d93-48ab-b013-934f8ea06d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:23.183649 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Flow 'volume_create_manager' (567f7277-6f55-41d7-9a03-fe9f2b8ac912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:23.215601 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-291b102d-ba77-4570-8aae-98297c51e2b7 tempest-VolumesCloneTest-1500773550 None] Created volume successfully. Jul 30 21:30:23.251859 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] Created reservations ['7dc13db9-a540-45f2-9354-0e5d69c21a00', 'dae6fec4-5405-4886-b9bb-01ce8b95fdbf', '1e0d761a-5734-4ab2-af1f-c309e408135b', '21421f8d-4c67-4b71-a2b3-6bacf2cdc58e'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:23.264925 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=53,cinder:UPDATE=26,cinder:INSERT=20,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:23.310982 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:23.379423 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:23.430647 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:23.434760 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] Deleted volume successfully. Jul 30 21:30:23.451825 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-204c4a47-d61f-4931-88ed-1e85de1f961e tempest-VolumesGetTest-331796126 None] Lock "cinder-7fc7820f-4b3d-42c5-8c75-d6246fea4c93-delete_volume" released by "delete_volume" :: held 0.672s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:23.851474 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] Acquiring lock "cinder-a5af8298-472d-46d2-a4d0-8db5ff19fb1e-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:23.874350 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] Lock "cinder-a5af8298-472d-46d2-a4d0-8db5ff19fb1e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:24.002133 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:24.128095 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:24.141408 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] deleting rbd volume volume-a5af8298-472d-46d2-a4d0-8db5ff19fb1e {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:24.373029 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] Acquiring lock "cinder-3303c0e9-1cca-45a0-8cb5-834368b7cf17-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:24.388445 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] Lock "cinder-3303c0e9-1cca-45a0-8cb5-834368b7cf17-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:24.473399 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:24.548630 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:24.558644 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] deleting rbd volume volume-3303c0e9-1cca-45a0-8cb5-834368b7cf17 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:24.561616 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:30:24.602119 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] deleting parent snapshot volume-a5af8298-472d-46d2-a4d0-8db5ff19fb1e.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:30:24.942889 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] Created reservations ['8da7d154-48a5-4c1a-92d4-6de0e0324deb', '2623adf8-b948-46da-8fc4-4abdae504dfe', '925e3c87-9659-4055-9363-b5ec0c0428ef', '3e899b2b-a991-4178-8fb3-ba53cc85f191'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:25.017803 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:30:25.072656 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] Volume volume-9922ce88-0793-4e58-b493-17f44599a857 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:25.075796 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] deleting parent snapshot volume-3303c0e9-1cca-45a0-8cb5-834368b7cf17.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:30:25.605349 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] Acquiring lock "cinder-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:25.645905 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] Lock "cinder-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:25.699345 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:25.778609 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:25.833035 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:25.839995 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] Deleted volume successfully. Jul 30 21:30:25.848764 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] Created reservations ['06226a4b-a33d-4e80-8554-b6b8a9968bbe', '0228f733-2681-480b-8cb7-5fe3ac42dc9d', '8da5af18-f477-4462-8b90-78d4da1c78b3', 'ad96a0dd-a284-402b-baa0-2b9ca4917bd4'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:25.893920 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:25.979965 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:25.980458 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] Volume volume-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:26.003207 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] deleting rbd volume volume-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:26.046812 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c7b8707e-e69d-4bdd-ada4-24483dc20ae9 tempest-VolumesGetTest-331796126 None] Lock "cinder-a5af8298-472d-46d2-a4d0-8db5ff19fb1e-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:26.132294 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:26.199405 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:26.266655 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:26.270800 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] Deleted volume successfully. Jul 30 21:30:26.298046 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-9b01a4eb-423d-4ec5-a29a-c0d56775c839 tempest-VolumesCloneTest-1500773550 None] Lock "cinder-3303c0e9-1cca-45a0-8cb5-834368b7cf17-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:26.509538 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] Created reservations ['083d75e0-9d4b-4ca8-ac49-1a78cdef4d5d', 'd97696e7-5634-45ef-965b-a6324f52f706', 'bb9a314f-eed3-4d23-950a-08e585e69161', 'a9e44993-94b7-472f-a405-a6d685dfe49c'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:26.673397 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:26.732248 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:26.790122 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:26.796430 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] Acquiring lock "cinder-9922ce88-0793-4e58-b493-17f44599a857-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:26.812243 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] Deleted volume successfully. Jul 30 21:30:26.843575 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] Lock "cinder-9922ce88-0793-4e58-b493-17f44599a857-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:26.881044 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-25abbcb7-3342-489f-85db-3e7d7f4dc131 tempest-VolumesGetTest-331796126 None] Lock "cinder-f0d7b3d1-d5e1-48d9-b9f1-de3b01d9bd35-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:26.887613 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=60,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=5 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:26.944073 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:27.074429 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:27.075774 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] Volume volume-9922ce88-0793-4e58-b493-17f44599a857 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:27.090452 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] deleting rbd volume volume-9922ce88-0793-4e58-b493-17f44599a857 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:27.622613 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] Created reservations ['7219a30b-6220-401e-bca0-f6fbbad8ced5', 'a9a7369a-3bee-44c9-aeb2-ae46f079052a', '146022df-7a21-4b77-9209-45cc2119b907', 'dbf114c7-4484-41ba-8f94-708c85c5c4da'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:27.735244 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:27.824578 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:27.890473 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:27.895635 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] Deleted volume successfully. Jul 30 21:30:27.916697 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6ee82edd-8e33-49e4-acf8-d6f7b22615a0 tempest-VolumesCloneTest-1500773550 None] Lock "cinder-9922ce88-0793-4e58-b493-17f44599a857-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:28.120683 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] Acquiring lock "cinder-3a92e20b-5bf7-449a-8b51-5da374eb0f44-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:28.136154 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] Lock "cinder-3a92e20b-5bf7-449a-8b51-5da374eb0f44-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:28.139785 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=47,cinder:UPDATE=40,cinder:DELETE=3,cinder:INSERT=10 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:28.246045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:28.464390 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:28.479779 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] deleting rbd volume volume-3a92e20b-5bf7-449a-8b51-5da374eb0f44 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:28.861919 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:30:28.949213 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] deleting parent snapshot volume-3a92e20b-5bf7-449a-8b51-5da374eb0f44.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:30:30.088753 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] Created reservations ['f83fa793-8ab2-4d42-9e2a-35519d981870', 'f31af7f3-8173-4476-8a85-e6da2461e903', '40533880-f7f0-4fe6-9552-e8472c39e708', 'd2201eee-6ae9-47bd-a5da-46e0ab7546ba'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:30.188776 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:30.280067 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:30.349498 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:30.359118 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] Deleted volume successfully. Jul 30 21:30:30.423018 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6daeb8f7-93ff-417b-9d67-56e89475d220 tempest-VolumesCloneTest-1500773550 None] Lock "cinder-3a92e20b-5bf7-449a-8b51-5da374eb0f44-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:30.596932 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] Acquiring lock "cinder-5259eece-a7b8-4d82-841f-c2929c3d99cb-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:30.617908 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] Lock "cinder-5259eece-a7b8-4d82-841f-c2929c3d99cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:30.754692 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:30.907366 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:30.919790 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] deleting rbd volume volume-5259eece-a7b8-4d82-841f-c2929c3d99cb {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:31.293570 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:30:31.361987 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] deleting parent snapshot volume-5259eece-a7b8-4d82-841f-c2929c3d99cb.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:30:32.133269 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] Created reservations ['4bba9531-1343-45e4-bfa4-afe0c677c228', '476b7a52-74be-4521-b1b8-ec20e5464f22', '4d07ebd6-e5bf-4edb-97e2-a8fd2d8a07e6', '7908eac1-2fb9-4a40-b053-37350fdbe715'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:32.250927 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:32.322168 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:32.396184 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:32.412166 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] Deleted volume successfully. Jul 30 21:30:32.438829 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-5ac4da12-2962-4996-95e4-323ed1d9a5ad tempest-VolumesCloneTest-1500773550 None] Lock "cinder-5259eece-a7b8-4d82-841f-c2929c3d99cb-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:38.311559 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:38.343572 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Flow 'volume_create_manager' (09cde774-80b3-4fce-992d-3586ce8751f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:38.350153 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69526c16-2e26-4e9e-ae96-09147e60944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.379485 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69526c16-2e26-4e9e-ae96-09147e60944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-295847384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=07286e2e-32f1-4f58-8688-601b42199006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782c0622189b4280954eb7b23d276505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:38Z,use_quota=True,user_id='fb3c692ee32d4e61aa6fc5a6c08af4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.386933 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0be656-b103-4abc-8c9b-5f3e58fea81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.393380 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0be656-b103-4abc-8c9b-5f3e58fea81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.404570 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ef9bee-9c29-4263-9752-c3c4cbb16989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.408669 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ef9bee-9c29-4263-9752-c3c4cbb16989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07286e2e-32f1-4f58-8688-601b42199006', 'volume_name': 'volume-07286e2e-32f1-4f58-8688-601b42199006', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.414551 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d6a854-e4dc-45d8-ba89-4222aea2e909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.419186 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d6a854-e4dc-45d8-ba89-4222aea2e909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.429293 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7806a377-4ed7-4569-acbf-dc2fb29cdd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.433863 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Volume 07286e2e-32f1-4f58-8688-601b42199006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07286e2e-32f1-4f58-8688-601b42199006', 'volume_size': 1} Jul 30 21:30:38.435691 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] creating volume 'volume-07286e2e-32f1-4f58-8688-601b42199006' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:38.436583 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:38.547017 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:38.594024 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Flow 'volume_create_manager' (bba288d2-9979-4d3e-8fd9-f9710c6b7bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:38.605407 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0438aeba-ab2d-4a95-8623-fbb6df6ff0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.650377 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:38.652033 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:38.656331 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7806a377-4ed7-4569-acbf-dc2fb29cdd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07286e2e-32f1-4f58-8688-601b42199006', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.662049 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7204f2c-e62a-4131-bac3-d6175fa4c811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.676514 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0438aeba-ab2d-4a95-8623-fbb6df6ff0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-211192855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f6c018d-a2e4-46fd-babd-c79cfe739e55,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be195e90c98548f8a352aa37f02acd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:38Z,use_quota=True,user_id='58883712558f43d08eae47f7c84f447c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.681808 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726e83c9-a277-4b6c-b819-21257fb481fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.686937 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726e83c9-a277-4b6c-b819-21257fb481fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.704783 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d24b63f-2383-46f4-99ae-ea6a0aa869ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.712025 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d24b63f-2383-46f4-99ae-ea6a0aa869ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6c018d-a2e4-46fd-babd-c79cfe739e55', 'volume_name': 'volume-4f6c018d-a2e4-46fd-babd-c79cfe739e55', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.723751 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d281b0-9c83-43b4-b82c-9376fd375ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.732834 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d281b0-9c83-43b4-b82c-9376fd375ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.739420 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be7dc4a-47a8-4d8b-ad20-21597dbfdd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.742132 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Volume 4f6c018d-a2e4-46fd-babd-c79cfe739e55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6c018d-a2e4-46fd-babd-c79cfe739e55', 'volume_size': 1} Jul 30 21:30:38.743981 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] creating volume 'volume-4f6c018d-a2e4-46fd-babd-c79cfe739e55' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:38.745018 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:38.833421 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Volume volume-07286e2e-32f1-4f58-8688-601b42199006 (07286e2e-32f1-4f58-8688-601b42199006): created successfully Jul 30 21:30:38.837913 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7204f2c-e62a-4131-bac3-d6175fa4c811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.844599 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Flow 'volume_create_manager' (09cde774-80b3-4fce-992d-3586ce8751f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:38.867178 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f5f976e1-2167-4b30-9d17-8c464e581c18 tempest-VolumesListAdminTestJSON-151400192 None] Created volume successfully. Jul 30 21:30:38.896034 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:38.896459 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:38.904765 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be7dc4a-47a8-4d8b-ad20-21597dbfdd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6c018d-a2e4-46fd-babd-c79cfe739e55', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.916533 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d651e66a-e077-489c-b81f-db6364e9b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:38.968038 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Volume volume-4f6c018d-a2e4-46fd-babd-c79cfe739e55 (4f6c018d-a2e4-46fd-babd-c79cfe739e55): created successfully Jul 30 21:30:38.976381 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d651e66a-e077-489c-b81f-db6364e9b776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:38.986251 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Flow 'volume_create_manager' (bba288d2-9979-4d3e-8fd9-f9710c6b7bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:39.003729 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c0246195-a6a0-4a35-92b4-8443542d5b39 tempest-VolumesListTestJSON-104923876 None] Created volume successfully. Jul 30 21:30:39.512771 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:39.561451 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (d00a62b9-38d5-4226-addf-6675071c58c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:39.585664 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac05778-9b62-4284-803c-3380de6dccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:39.629722 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac05778-9b62-4284-803c-3380de6dccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2041872311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=629d4006-7b40-4644-8678-fd6e4b6063f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86550d66e9144788967e5b514cda82d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:39Z,use_quota=True,user_id='937935818cda4a6e8b9104d38aa3a8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:39.641956 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4911fe25-ca69-4101-8b6c-3cee67b8f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:39.651056 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4911fe25-ca69-4101-8b6c-3cee67b8f173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:39.666001 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a7e4206-879c-42a0-b061-5d28ca2eb901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:39.677173 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a7e4206-879c-42a0-b061-5d28ca2eb901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629d4006-7b40-4644-8678-fd6e4b6063f7', 'volume_name': 'volume-629d4006-7b40-4644-8678-fd6e4b6063f7', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:39.684733 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ecb8f4-dab7-4ae9-91e5-bf37a5c5220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:39.695273 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ecb8f4-dab7-4ae9-91e5-bf37a5c5220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:39.706805 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece37316-0f07-40b6-b045-925f63e1fb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:39.712096 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Volume 629d4006-7b40-4644-8678-fd6e4b6063f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629d4006-7b40-4644-8678-fd6e4b6063f7', 'volume_size': 1} Jul 30 21:30:39.717371 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] creating volume 'volume-629d4006-7b40-4644-8678-fd6e4b6063f7' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:39.718040 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:39.833679 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:39.834490 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:39.839353 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece37316-0f07-40b6-b045-925f63e1fb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629d4006-7b40-4644-8678-fd6e4b6063f7', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:39.851799 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f0dfbf-fff4-4b53-b56a-4c11cce6c9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:39.894125 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Volume volume-629d4006-7b40-4644-8678-fd6e4b6063f7 (629d4006-7b40-4644-8678-fd6e4b6063f7): created successfully Jul 30 21:30:39.900400 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f0dfbf-fff4-4b53-b56a-4c11cce6c9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:39.908255 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (d00a62b9-38d5-4226-addf-6675071c58c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:39.934834 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-6b541e45-0bc6-4557-91e2-288b1725f0ef tempest-VolumesSnapshotTestJSON-1137680000 None] Created volume successfully. Jul 30 21:30:40.218097 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:40.242223 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Flow 'volume_create_manager' (e1d06dba-5e39-420a-aa02-0c076155dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:40.249872 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30cd86d-67de-4cc2-9f88-24e235963a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.269512 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30cd86d-67de-4cc2-9f88-24e235963a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1228523526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=40f46021-c562-49fc-bcbf-913911b016ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782c0622189b4280954eb7b23d276505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:40Z,use_quota=True,user_id='fb3c692ee32d4e61aa6fc5a6c08af4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.276674 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d87e5a0-ea97-40c5-9417-329c783cd4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.283207 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d87e5a0-ea97-40c5-9417-329c783cd4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.290852 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90283aa-00b7-40e7-8145-62e35437ed5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.295271 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90283aa-00b7-40e7-8145-62e35437ed5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f46021-c562-49fc-bcbf-913911b016ff', 'volume_name': 'volume-40f46021-c562-49fc-bcbf-913911b016ff', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.300719 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8477b8-463d-45c9-8b56-0b71501d016f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.304876 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8477b8-463d-45c9-8b56-0b71501d016f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.311085 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd11971-7a30-45dc-9ca4-2fcf93b2b016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.312428 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Volume 40f46021-c562-49fc-bcbf-913911b016ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f46021-c562-49fc-bcbf-913911b016ff', 'volume_size': 1} Jul 30 21:30:40.313028 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] creating volume 'volume-40f46021-c562-49fc-bcbf-913911b016ff' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:40.313876 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:40.360394 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:40.385591 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Flow 'volume_create_manager' (0922b913-cb64-402d-8fdd-374e3853c8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:40.404767 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e550ce8-091c-4574-8968-217e39fd2689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.433303 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e550ce8-091c-4574-8968-217e39fd2689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1069001745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=40200136-d113-4d89-956e-4d484a690036,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be195e90c98548f8a352aa37f02acd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:40Z,use_quota=True,user_id='58883712558f43d08eae47f7c84f447c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.439450 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec9a08c-b76c-4949-b932-e137fd14160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.445770 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec9a08c-b76c-4949-b932-e137fd14160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.452618 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3c65da-fa36-48dd-bdc7-63e460069ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.458404 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3c65da-fa36-48dd-bdc7-63e460069ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40200136-d113-4d89-956e-4d484a690036', 'volume_name': 'volume-40200136-d113-4d89-956e-4d484a690036', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.493386 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f128ec-8b57-41a2-80c6-09befd4fbc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.499948 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f128ec-8b57-41a2-80c6-09befd4fbc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.511257 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7ab827-f839-4da2-9296-a7203316640f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.512682 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Volume 40200136-d113-4d89-956e-4d484a690036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40200136-d113-4d89-956e-4d484a690036', 'volume_size': 1} Jul 30 21:30:40.513376 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] creating volume 'volume-40200136-d113-4d89-956e-4d484a690036' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:40.515341 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:40.573758 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:40.574153 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:40.578556 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd11971-7a30-45dc-9ca4-2fcf93b2b016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f46021-c562-49fc-bcbf-913911b016ff', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.590195 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d799506-bacc-48f9-8566-f5672835d129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.600713 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:40.601751 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:40.607017 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7ab827-f839-4da2-9296-a7203316640f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40200136-d113-4d89-956e-4d484a690036', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.613537 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fe206a-15da-4182-926c-0557ce26cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:40.631458 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Volume volume-40f46021-c562-49fc-bcbf-913911b016ff (40f46021-c562-49fc-bcbf-913911b016ff): created successfully Jul 30 21:30:40.638917 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d799506-bacc-48f9-8566-f5672835d129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.648528 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Flow 'volume_create_manager' (e1d06dba-5e39-420a-aa02-0c076155dda4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:40.654771 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Volume volume-40200136-d113-4d89-956e-4d484a690036 (40200136-d113-4d89-956e-4d484a690036): created successfully Jul 30 21:30:40.658350 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fe206a-15da-4182-926c-0557ce26cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:40.668139 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Flow 'volume_create_manager' (0922b913-cb64-402d-8fdd-374e3853c8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:40.682187 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f95ee02f-6cf8-48ab-8076-08756d0fcb11 tempest-VolumesListAdminTestJSON-151400192 None] Created volume successfully. Jul 30 21:30:40.689886 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-9c793c85-7601-45f2-b58b-99b29eb2586a tempest-VolumesListTestJSON-104923876 None] Created volume successfully. Jul 30 21:30:40.813258 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=55,cinder:INSERT=8,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:40.826245 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0c1948dc-065c-4712-b09e-658337991321 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:41.694020 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0c1948dc-065c-4712-b09e-658337991321 tempest-VolumesSnapshotTestJSON-1137680000 None] Create snapshot completed successfully Jul 30 21:30:41.803511 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:41.827093 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Flow 'volume_create_manager' (6d82e669-c350-4ab9-a02f-0d1fe9dcaa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:41.834096 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c789d465-9672-4f5b-b438-54e64035796c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:41.854101 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c789d465-9672-4f5b-b438-54e64035796c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-209181638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5a8fdeaf-b208-4470-a13b-9432dc5f40db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782c0622189b4280954eb7b23d276505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:42Z,use_quota=True,user_id='fb3c692ee32d4e61aa6fc5a6c08af4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:41.860448 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c26478-81ca-4f75-9c09-d3ced54a8224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:41.869675 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c26478-81ca-4f75-9c09-d3ced54a8224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:41.875855 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714be9af-a827-4e66-97bf-9ba0f644ef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:41.892856 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714be9af-a827-4e66-97bf-9ba0f644ef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8fdeaf-b208-4470-a13b-9432dc5f40db', 'volume_name': 'volume-5a8fdeaf-b208-4470-a13b-9432dc5f40db', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:41.902740 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d04c0f2-db4c-43dd-8929-9639cbbef08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:41.914213 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d04c0f2-db4c-43dd-8929-9639cbbef08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:41.919676 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4579ff3a-1052-49e0-880b-5375d2aeef32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:41.921052 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Volume 5a8fdeaf-b208-4470-a13b-9432dc5f40db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8fdeaf-b208-4470-a13b-9432dc5f40db', 'volume_size': 1} Jul 30 21:30:41.921671 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] creating volume 'volume-5a8fdeaf-b208-4470-a13b-9432dc5f40db' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:41.922558 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:42.049780 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:42.088844 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Flow 'volume_create_manager' (756a2f60-9d81-49f3-ad76-a735234d917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:42.096054 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5d3279-bc01-4cbe-81bd-3b2322b8f4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:42.114584 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:42.114966 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:42.118809 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4579ff3a-1052-49e0-880b-5375d2aeef32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8fdeaf-b208-4470-a13b-9432dc5f40db', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:42.123834 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6c0c60-f489-4f3e-9ecc-1ff817801742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:42.146229 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5d3279-bc01-4cbe-81bd-3b2322b8f4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1874625170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7122ae69-4839-4e78-bb63-0401313b0d93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be195e90c98548f8a352aa37f02acd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:42Z,use_quota=True,user_id='58883712558f43d08eae47f7c84f447c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:42.156549 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c9795a-9ecd-4ae7-bd0b-92cbceb4b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:42.173009 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c9795a-9ecd-4ae7-bd0b-92cbceb4b640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:42.178177 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e32604e-8d71-4dd5-b0a7-d3664bfa841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:42.182997 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e32604e-8d71-4dd5-b0a7-d3664bfa841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7122ae69-4839-4e78-bb63-0401313b0d93', 'volume_name': 'volume-7122ae69-4839-4e78-bb63-0401313b0d93', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:42.188168 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97db8a19-e6cd-4a83-ae0b-c29e6521d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:42.192522 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97db8a19-e6cd-4a83-ae0b-c29e6521d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:42.197271 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2061b4c1-bc2b-4058-b77d-c4599fb9e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:42.198325 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Volume 7122ae69-4839-4e78-bb63-0401313b0d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7122ae69-4839-4e78-bb63-0401313b0d93', 'volume_size': 1} Jul 30 21:30:42.198767 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] creating volume 'volume-7122ae69-4839-4e78-bb63-0401313b0d93' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:42.199441 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:42.266068 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Volume volume-5a8fdeaf-b208-4470-a13b-9432dc5f40db (5a8fdeaf-b208-4470-a13b-9432dc5f40db): created successfully Jul 30 21:30:42.270244 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6c0c60-f489-4f3e-9ecc-1ff817801742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:42.277333 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Flow 'volume_create_manager' (6d82e669-c350-4ab9-a02f-0d1fe9dcaa91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:42.288231 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-4c5e542c-4be3-406b-88b5-47fbcd34a262 tempest-VolumesListAdminTestJSON-151400192 None] Created volume successfully. Jul 30 21:30:42.323040 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:42.323497 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:42.330371 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2061b4c1-bc2b-4058-b77d-c4599fb9e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7122ae69-4839-4e78-bb63-0401313b0d93', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:42.340205 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104bf6a7-9ec4-4a95-9d8e-369d6f008e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:42.351234 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Volume volume-7122ae69-4839-4e78-bb63-0401313b0d93 (7122ae69-4839-4e78-bb63-0401313b0d93): created successfully Jul 30 21:30:42.355000 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104bf6a7-9ec4-4a95-9d8e-369d6f008e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:42.360537 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Flow 'volume_create_manager' (756a2f60-9d81-49f3-ad76-a735234d917f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:42.378988 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-1b2756f0-ee53-4ecc-be2d-2a7d327feb90 tempest-VolumesListTestJSON-104923876 None] Created volume successfully. Jul 30 21:30:42.408403 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.driver [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Creating a new backup for volume volume-629d4006-7b40-4644-8678-fd6e4b6063f7. {{(pid=124008) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1213}} Jul 30 21:30:42.441251 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] cloning volumes/volume-629d4006-7b40-4644-8678-fd6e4b6063f7@snapshot-759f2a4c-2e6d-422f-b244-6260c4440cef to volume-9910e694-fcb7-4f76-90fa-4aea230b7d47 {{(pid=124008) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jul 30 21:30:42.441899 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:42.477608 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:42.573767 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:42.574147 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:42.578679 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:42.617399 ncdv-master-1 cinder-volume[124008]: WARNING cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Jul 30 21:30:42.635218 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=63,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:42.641068 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-30T21:30:42Z,data_timestamp=2022-07-30T21:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1274744317',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=3f54a4c5-8b39-4562-9dbd-eb22fd439f8e,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='86550d66e9144788967e5b514cda82d7',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='759f2a4c-2e6d-422f-b244-6260c4440cef',status='creating',temp_snapshot_id=None,temp_volume_id='9910e694-fcb7-4f76-90fa-4aea230b7d47',updated_at=None,user_id='937935818cda4a6e8b9104d38aa3a8b1',volume_id=629d4006-7b40-4644-8678-fd6e4b6063f7) Jul 30 21:30:42.641912 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.backup.rpcapi [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] continue_backup in rpcapi backup_id 3f54a4c5-8b39-4562-9dbd-eb22fd439f8e {{(pid=124008) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jul 30 21:30:42.768686 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:30:43.307612 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:43.333443 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Flow 'volume_create_manager' (deff8c13-7baa-4076-b33a-b3058abe3f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:43.351415 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb06ad65-918e-4906-b152-b111b91b44f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:43.374514 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb06ad65-918e-4906-b152-b111b91b44f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e2717c1d-d40b-47ee-a696-b2eb0dcf161b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3066688ad2bf4c4c85e3819bb21cd70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:43Z,use_quota=True,user_id='687e04d9904a45bf8b8597d51094aacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:43.396894 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7081c33f-8004-4212-acf0-bb9ea0dcd00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:43.402314 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7081c33f-8004-4212-acf0-bb9ea0dcd00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:43.408199 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289f6716-d430-4625-84be-5169aa139e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:43.412986 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289f6716-d430-4625-84be-5169aa139e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2717c1d-d40b-47ee-a696-b2eb0dcf161b', 'volume_name': 'volume-e2717c1d-d40b-47ee-a696-b2eb0dcf161b', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:43.419727 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f28050-7f59-40f1-8a7d-6baf45c080a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:43.423795 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f28050-7f59-40f1-8a7d-6baf45c080a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:43.428780 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39b8a0c-accb-43d4-b468-9220057c2774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:43.431145 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Volume e2717c1d-d40b-47ee-a696-b2eb0dcf161b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2717c1d-d40b-47ee-a696-b2eb0dcf161b', 'volume_size': 1} Jul 30 21:30:43.431610 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] creating volume 'volume-e2717c1d-d40b-47ee-a696-b2eb0dcf161b' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:43.432803 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:43.548777 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:43.549320 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:43.553432 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39b8a0c-accb-43d4-b468-9220057c2774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2717c1d-d40b-47ee-a696-b2eb0dcf161b', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:43.560364 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0ae66c-aae0-4857-bba3-3f9378627b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:43.573725 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Volume volume-e2717c1d-d40b-47ee-a696-b2eb0dcf161b (e2717c1d-d40b-47ee-a696-b2eb0dcf161b): created successfully Jul 30 21:30:43.578393 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0ae66c-aae0-4857-bba3-3f9378627b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:43.584338 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Flow 'volume_create_manager' (deff8c13-7baa-4076-b33a-b3058abe3f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:43.597022 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e04b7490-817d-4b35-9ad1-b063ff9d88c1 tempest-VolumesListAdminTestJSON-865500461 None] Created volume successfully. Jul 30 21:30:43.716381 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.948s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:30:43.717065 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9910e694-fcb7-4f76-90fa-4aea230b7d47', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '9910e694-fcb7-4f76-90fa-4aea230b7d47', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:30:43.733019 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Initialize volume connection completed successfully. Jul 30 21:30:44.504132 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] Acquiring lock "cinder-e2717c1d-d40b-47ee-a696-b2eb0dcf161b-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:44.556274 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] Lock "cinder-e2717c1d-d40b-47ee-a696-b2eb0dcf161b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:44.617179 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] Acquiring lock "cinder-5a8fdeaf-b208-4470-a13b-9432dc5f40db-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:44.689345 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:44.824692 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:44.825298 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] Volume volume-e2717c1d-d40b-47ee-a696-b2eb0dcf161b is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:44.850120 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] deleting rbd volume volume-e2717c1d-d40b-47ee-a696-b2eb0dcf161b {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:44.864438 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] Lock "cinder-5a8fdeaf-b208-4470-a13b-9432dc5f40db-delete_volume" acquired by "delete_volume" :: waited 0.247s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:44.919924 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:45.039823 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:45.040446 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] Volume volume-5a8fdeaf-b208-4470-a13b-9432dc5f40db is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:45.072181 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] deleting rbd volume volume-5a8fdeaf-b208-4470-a13b-9432dc5f40db {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:45.687041 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] Created reservations ['f4d4626f-1e33-4882-97b3-8cc6402fddd3', 'cc023004-ea3e-4712-b5d2-27f9c5c0e605', '5351f89a-3f6a-4a86-88c2-0150b781f419', '741f936b-b209-4f31-92a7-701c2a684aa5'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:45.758601 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] Created reservations ['379d4798-4bb9-4a0e-982c-59fbd44bd6fc', '7d24e26a-e1c1-405f-95ac-567525622f1f', 'f4332692-6ce4-4d3a-bb16-52950290a58e', 'aea96638-c54e-4e91-be54-fa9f45b49aee'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:45.820149 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:45.901206 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:45.969974 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:45.981264 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] Acquiring lock "cinder-40f46021-c562-49fc-bcbf-913911b016ff-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:45.986279 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] Deleted volume successfully. Jul 30 21:30:46.009413 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] Lock "cinder-40f46021-c562-49fc-bcbf-913911b016ff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:46.032229 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:46.090528 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:46.156091 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:46.167660 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8633a89b-f515-4308-aafb-e277e2296b31 tempest-VolumesListAdminTestJSON-865500461 None] Lock "cinder-e2717c1d-d40b-47ee-a696-b2eb0dcf161b-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:46.197127 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] Deleted volume successfully. Jul 30 21:30:46.260476 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:46.369893 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:46.370331 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] Volume volume-40f46021-c562-49fc-bcbf-913911b016ff is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:46.387608 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] deleting rbd volume volume-40f46021-c562-49fc-bcbf-913911b016ff {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:46.389399 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3af9db13-e164-44f7-9efc-bada837a0b45 tempest-VolumesListAdminTestJSON-151400192 None] Lock "cinder-5a8fdeaf-b208-4470-a13b-9432dc5f40db-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:46.652790 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] Acquiring lock "cinder-7122ae69-4839-4e78-bb63-0401313b0d93-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:46.672460 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] Lock "cinder-7122ae69-4839-4e78-bb63-0401313b0d93-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:46.761266 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:46.832058 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:46.832574 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] Volume volume-7122ae69-4839-4e78-bb63-0401313b0d93 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:46.840091 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] deleting rbd volume volume-7122ae69-4839-4e78-bb63-0401313b0d93 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:46.940971 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] Created reservations ['58346d0b-3e37-4b12-b56d-f30a54ea3fd5', 'f48a3026-07bf-4060-a8cf-5fc141eb5823', 'a9e6a881-986f-447c-a310-aad7325cf41c', '6419d287-fb0b-48f4-bc29-f2698ca48b1f'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:47.005578 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:DELETE=5,cinder:SELECT=62,cinder:UPDATE=30,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:47.016113 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:47.090430 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:47.151825 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:47.172631 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] Acquiring lock "cinder-07286e2e-32f1-4f58-8688-601b42199006-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:47.182705 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] Deleted volume successfully. Jul 30 21:30:47.216909 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] Lock "cinder-07286e2e-32f1-4f58-8688-601b42199006-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:47.224996 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c31077cf-16a6-43ac-828a-db1fbb55ab33 tempest-VolumesListAdminTestJSON-151400192 None] Lock "cinder-40f46021-c562-49fc-bcbf-913911b016ff-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:47.269262 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] Created reservations ['87d10087-5177-41ad-a3c5-e34ef546adf9', '9697565a-27ae-42a9-9be0-b86acaf90987', '00850a45-2d8a-4f23-a40b-08a667ad8ddd', 'b459edbb-9b6f-4c93-9da6-3c47bb7dd140'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:47.277994 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=61,cinder:UPDATE=25,cinder:INSERT=12,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:47.293972 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:47.378621 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:47.379183 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] Volume volume-07286e2e-32f1-4f58-8688-601b42199006 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:47.398298 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] deleting rbd volume volume-07286e2e-32f1-4f58-8688-601b42199006 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:47.470429 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:47.527642 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:47.608905 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:47.626956 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] Deleted volume successfully. Jul 30 21:30:47.652571 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-78513a65-ce24-46f8-b298-6bcf7d5b5fc1 tempest-VolumesListTestJSON-104923876 None] Lock "cinder-7122ae69-4839-4e78-bb63-0401313b0d93-delete_volume" released by "delete_volume" :: held 0.980s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:47.864724 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] Acquiring lock "cinder-40200136-d113-4d89-956e-4d484a690036-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:47.895003 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] Lock "cinder-40200136-d113-4d89-956e-4d484a690036-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:47.978791 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:48.053991 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:48.054379 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] Volume volume-40200136-d113-4d89-956e-4d484a690036 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:48.060921 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] deleting rbd volume volume-40200136-d113-4d89-956e-4d484a690036 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:48.145048 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] Created reservations ['d0d0e901-2fc2-423f-a37c-aa878d9c9e91', 'ff6c6935-ae3e-4ad5-93d9-c61a9e4b1a93', 'fdb8fc67-44b7-4670-bc96-ffd5631b9bf6', 'aaec3038-54df-4c12-9942-c5572db09822'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:48.237307 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:48.317561 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:48.376682 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:48.403575 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] Deleted volume successfully. Jul 30 21:30:48.438684 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b8e0d54e-3c16-4c39-bea1-93f5d0744546 tempest-VolumesListAdminTestJSON-151400192 None] Lock "cinder-07286e2e-32f1-4f58-8688-601b42199006-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:48.499886 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] Created reservations ['cc2b3f91-4747-4ce8-8367-6927e4228d22', 'da665efe-1290-4324-9388-daf7e4c7b4a6', '641e4935-1e0d-4108-8141-78192496a87e', 'ffd5c79c-0cc9-43b2-9d93-b47cc6d20688'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:48.605603 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:48.709046 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:48.785503 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:48.790955 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] Deleted volume successfully. Jul 30 21:30:48.815128 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-0b04d8a6-2b46-4c9a-bda4-bf5fd4ff85be tempest-VolumesListTestJSON-104923876 None] Lock "cinder-40200136-d113-4d89-956e-4d484a690036-delete_volume" released by "delete_volume" :: held 0.923s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:49.196176 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] Acquiring lock "cinder-4f6c018d-a2e4-46fd-babd-c79cfe739e55-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:49.228570 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] Lock "cinder-4f6c018d-a2e4-46fd-babd-c79cfe739e55-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:49.287767 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:49.367791 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:49.368120 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] Volume volume-4f6c018d-a2e4-46fd-babd-c79cfe739e55 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:30:49.389430 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] deleting rbd volume volume-4f6c018d-a2e4-46fd-babd-c79cfe739e55 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:49.979981 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] Created reservations ['a7059574-d02c-4ee4-9d12-1f14b08d5cfc', 'd404688c-f5e9-4c75-850d-e4405910408a', 'a727c70a-150a-4355-af30-9d1c0832b8e7', 'c5ba6e74-35a5-41cd-bfed-08f762c30ec1'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:30:50.123809 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:50.225507 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:50.261743 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:30:50.267008 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] Deleted volume successfully. Jul 30 21:30:50.299133 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a61552bf-adea-4c2c-a20d-ae28ab473476 tempest-VolumesListTestJSON-104923876 None] Lock "cinder-4f6c018d-a2e4-46fd-babd-c79cfe739e55-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:55.032688 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Terminate volume connection completed successfully. Jul 30 21:30:55.058223 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Remove volume export completed successfully. Jul 30 21:30:55.106886 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-9910e694-fcb7-4f76-90fa-4aea230b7d47-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:30:55.121838 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-9910e694-fcb7-4f76-90fa-4aea230b7d47-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:30:55.148294 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:55.233551 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:30:55.251242 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] deleting rbd volume volume-9910e694-fcb7-4f76-90fa-4aea230b7d47 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:30:55.567071 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=52,cinder:UPDATE=39,cinder:INSERT=7,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:30:55.616073 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Deleted volume successfully. Jul 30 21:30:55.624093 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-54c0963d-5be1-491e-9c91-591f57d0e30b tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-9910e694-fcb7-4f76-90fa-4aea230b7d47-delete_volume" released by "delete_volume" :: held 0.502s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:30:59.236816 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:30:59.266230 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Flow 'volume_create_manager' (13906858-77a2-440c-9c16-c4a240df4ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:59.278035 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958b9bb1-ff5e-4ae4-81f2-22cef5615978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:59.299315 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958b9bb1-ff5e-4ae4-81f2-22cef5615978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-691811710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=31fad2df-e2ec-4aaf-a07c-2338953ba6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d6725c617b4a29a437ea385e84a684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:30:59Z,use_quota=True,user_id='0114359ded1f4ac588c8b1f0f31737ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:59.306932 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b249ba-d0e8-4bce-9fcf-c597cfbeaf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:59.312257 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b249ba-d0e8-4bce-9fcf-c597cfbeaf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:59.318411 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4602c2b9-97b9-4778-a80f-d21456c6871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:59.323520 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4602c2b9-97b9-4778-a80f-d21456c6871c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31fad2df-e2ec-4aaf-a07c-2338953ba6b2', 'volume_name': 'volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:59.329505 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826cc5a1-282a-4bd2-bb6b-fa9268b282c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:59.334952 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826cc5a1-282a-4bd2-bb6b-fa9268b282c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:59.339828 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9eb5690-5d68-4fd1-a56f-ae4ea0c7a135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:59.341536 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Volume 31fad2df-e2ec-4aaf-a07c-2338953ba6b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2', 'volume_size': 1} Jul 30 21:30:59.342608 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] creating volume 'volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:30:59.343548 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:30:59.469095 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:30:59.469960 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:30:59.486884 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9eb5690-5d68-4fd1-a56f-ae4ea0c7a135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:59.494247 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2cb46d-70df-40ca-85c0-bba43c8ee02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:30:59.512318 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Volume volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2 (31fad2df-e2ec-4aaf-a07c-2338953ba6b2): created successfully Jul 30 21:30:59.517700 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2cb46d-70df-40ca-85c0-bba43c8ee02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:30:59.530996 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Flow 'volume_create_manager' (13906858-77a2-440c-9c16-c4a240df4ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:30:59.544255 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-55eb53aa-147a-44d4-a4cf-37fa2b5ce7b3 tempest-VolumesActionsTest-1001371749 None] Created volume successfully. Jul 30 21:31:02.480875 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:31:02.516150 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Flow 'volume_create_manager' (029f9c33-a1b6-4f1e-b641-cc66c56ae8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:31:02.524412 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26632ab1-d40b-40a5-bece-2fc39a1bd9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:02.542299 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26632ab1-d40b-40a5-bece-2fc39a1bd9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1577860614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=600fb7d5-259f-4c12-a1f9-57e6e59664cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7b4209e06447d5abdff867f9a7adce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:31:02Z,use_quota=True,user_id='5a6da0171fac41fb934ed2b294081531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:02.548189 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a02c32c-7b33-42f6-b0ae-5e441290233f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:02.552360 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a02c32c-7b33-42f6-b0ae-5e441290233f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:02.558304 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b471eb-9037-4e76-9ab3-8613013d8d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:02.563351 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b471eb-9037-4e76-9ab3-8613013d8d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600fb7d5-259f-4c12-a1f9-57e6e59664cd', 'volume_name': 'volume-600fb7d5-259f-4c12-a1f9-57e6e59664cd', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:02.571087 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbc7d35-5cd0-40e7-96bb-2f81db6fa735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:02.575230 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbc7d35-5cd0-40e7-96bb-2f81db6fa735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:02.580949 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24d5e27-2f44-4354-8d41-3d3ea74649fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:02.582697 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Volume 600fb7d5-259f-4c12-a1f9-57e6e59664cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600fb7d5-259f-4c12-a1f9-57e6e59664cd', 'volume_size': 1} Jul 30 21:31:02.583334 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] creating volume 'volume-600fb7d5-259f-4c12-a1f9-57e6e59664cd' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:31:02.584173 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:31:02.739958 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:31:02.740436 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:31:02.769388 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24d5e27-2f44-4354-8d41-3d3ea74649fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600fb7d5-259f-4c12-a1f9-57e6e59664cd', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:02.783336 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef13778-c5ee-45fe-84df-bb4540f0ed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:02.801413 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Volume volume-600fb7d5-259f-4c12-a1f9-57e6e59664cd (600fb7d5-259f-4c12-a1f9-57e6e59664cd): created successfully Jul 30 21:31:02.809186 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef13778-c5ee-45fe-84df-bb4540f0ed47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:02.815880 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Flow 'volume_create_manager' (029f9c33-a1b6-4f1e-b641-cc66c56ae8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:31:02.828586 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b408a2a2-e2b4-4f66-b23a-211ce23bbaeb tempest-AttachVolumeTestJSON-1877777549 None] Created volume successfully. Jul 30 21:31:04.343203 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b req-3188f913-9288-4f8a-aa57-40d0d80deee2 tempest-AttachVolumeTestJSON-1877777549 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:31:05.980390 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b req-3188f913-9288-4f8a-aa57-40d0d80deee2 tempest-AttachVolumeTestJSON-1877777549 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.639s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:31:05.982934 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b req-3188f913-9288-4f8a-aa57-40d0d80deee2 tempest-AttachVolumeTestJSON-1877777549 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-600fb7d5-259f-4c12-a1f9-57e6e59664cd', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '600fb7d5-259f-4c12-a1f9-57e6e59664cd', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:31:06.031366 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b req-3188f913-9288-4f8a-aa57-40d0d80deee2 tempest-AttachVolumeTestJSON-1877777549 None] Connection info returned from driver {'name': 'volumes/volume-600fb7d5-259f-4c12-a1f9-57e6e59664cd', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '600fb7d5-259f-4c12-a1f9-57e6e59664cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9faec9a9-058e-4ed8-b31b-c0a3fa734996'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:31:06.168405 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=38,cinder:SELECT=52,cinder:INSERT=7,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:06.204985 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-6c3b0686-dfc8-4a8b-8cc5-e1a30e9bd21b req-3188f913-9288-4f8a-aa57-40d0d80deee2 tempest-AttachVolumeTestJSON-1877777549 None] attachment_update completed successfully. Jul 30 21:31:13.048578 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:31:13.072193 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (73fe5dd4-2697-4e67-821a-e99e547b34f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:31:13.079230 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4beabc2-00dd-4be3-b850-fc35b9e6aaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:13.099679 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4beabc2-00dd-4be3-b850-fc35b9e6aaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1575226354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3a0555a8-f248-41c2-b23f-fd458dbd282b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86550d66e9144788967e5b514cda82d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:31:13Z,use_quota=True,user_id='937935818cda4a6e8b9104d38aa3a8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:13.105855 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251441db-9e27-4985-956c-e85374569513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:13.110150 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251441db-9e27-4985-956c-e85374569513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:13.115115 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd1e4f9-cc5e-4353-991e-3429e0d8b021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:13.219561 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd1e4f9-cc5e-4353-991e-3429e0d8b021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a0555a8-f248-41c2-b23f-fd458dbd282b', 'volume_name': 'volume-3a0555a8-f248-41c2-b23f-fd458dbd282b', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:13.225631 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3152698-da3d-4726-8bff-e31ddc2bd9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:13.230162 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3152698-da3d-4726-8bff-e31ddc2bd9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:13.234995 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5835840f-d020-4e58-855d-466054dc0172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:13.236571 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume 3a0555a8-f248-41c2-b23f-fd458dbd282b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a0555a8-f248-41c2-b23f-fd458dbd282b', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:31:13.237215 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Cloning 3a0555a8-f248-41c2-b23f-fd458dbd282b from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:31:13.238024 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:31:13.248830 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:31:13.261505 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 31, 13, 254011)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:31:13.262151 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:31:13.263149 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:31:13.267747 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.019s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:31:13.268786 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:31:13.276831 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 31, 13, 272819)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:31:13.277372 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:31:13.277815 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:31:13.292389 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:31:13.358731 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] creating snapshot='volume-3a0555a8-f248-41c2-b23f-fd458dbd282b.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:31:13.726654 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-3a0555a8-f248-41c2-b23f-fd458dbd282b.clone_snap' to 'volume-3a0555a8-f248-41c2-b23f-fd458dbd282b' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:31:14.072948 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:31:14.075812 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:31:14.076204 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:31:14.114507 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:31:14.115487 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Marking volume 3a0555a8-f248-41c2-b23f-fd458dbd282b as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:31:14.131905 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to 3a0555a8-f248-41c2-b23f-fd458dbd282b. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:31:14.133156 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Creating volume glance metadata for volume 3a0555a8-f248-41c2-b23f-fd458dbd282b backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:31:14.275989 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5835840f-d020-4e58-855d-466054dc0172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0555a8-f248-41c2-b23f-fd458dbd282b', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:14.285108 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4760cc21-ff12-4e51-ba57-7a45313e7b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:31:14.300214 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume volume-3a0555a8-f248-41c2-b23f-fd458dbd282b (3a0555a8-f248-41c2-b23f-fd458dbd282b): created successfully Jul 30 21:31:14.307708 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4760cc21-ff12-4e51-ba57-7a45313e7b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:31:14.333527 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (73fe5dd4-2697-4e67-821a-e99e547b34f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:31:14.353577 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-61998804-e489-425c-9059-34d9e0a65d83 tempest-VolumesSnapshotTestJSON-1137680000 None] Created volume successfully. Jul 30 21:31:15.631529 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-4b4f61a2-3b8c-4539-831f-0551c5563059 req-fc8e7f82-724d-4489-8a55-3f56ba4d43c6 tempest-VolumesSnapshotTestJSON-1137680000 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:31:15.859415 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-66c047b0-4ef1-4202-8787-ef58c3812ffe tempest-VolumesActionsTest-1001371749 None] Acquiring lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2" by "attach_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:31:15.872573 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-66c047b0-4ef1-4202-8787-ef58c3812ffe tempest-VolumesActionsTest-1001371749 None] Lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2" acquired by "attach_volume" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:31:15.916818 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-66c047b0-4ef1-4202-8787-ef58c3812ffe tempest-VolumesActionsTest-1001371749 None] Attaching volume 31fad2df-e2ec-4aaf-a07c-2338953ba6b2 to instance 36d84983-d687-4119-97a2-c27a55ab6c0f at mountpoint /dev/sdb on host None. Jul 30 21:31:15.944406 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-66c047b0-4ef1-4202-8787-ef58c3812ffe tempest-VolumesActionsTest-1001371749 None] Attach volume completed successfully. Jul 30 21:31:15.951767 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-66c047b0-4ef1-4202-8787-ef58c3812ffe tempest-VolumesActionsTest-1001371749 None] Lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2" released by "attach_volume" :: held 0.079s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:31:16.069406 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:31:16.070535 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:31:16.108159 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:31:16.154666 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:31:16.166498 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-98e2dbaa-4863-4d30-a7f1-1f4d2d8f1910 tempest-VolumesActionsTest-1001371749 None] Acquiring lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-detach_volume" by "detach_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:31:16.180912 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-98e2dbaa-4863-4d30-a7f1-1f4d2d8f1910 tempest-VolumesActionsTest-1001371749 None] Lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:31:16.181533 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-98e2dbaa-4863-4d30-a7f1-1f4d2d8f1910 tempest-VolumesActionsTest-1001371749 None] Detaching volume 31fad2df-e2ec-4aaf-a07c-2338953ba6b2 from instance 36d84983-d687-4119-97a2-c27a55ab6c0f. Jul 30 21:31:16.237587 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-98e2dbaa-4863-4d30-a7f1-1f4d2d8f1910 tempest-VolumesActionsTest-1001371749 None] Detach volume completed successfully. Jul 30 21:31:16.243816 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-98e2dbaa-4863-4d30-a7f1-1f4d2d8f1910 tempest-VolumesActionsTest-1001371749 None] Lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:31:16.576659 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-4b4f61a2-3b8c-4539-831f-0551c5563059 req-fc8e7f82-724d-4489-8a55-3f56ba4d43c6 tempest-VolumesSnapshotTestJSON-1137680000 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.945s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:31:16.576659 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-4b4f61a2-3b8c-4539-831f-0551c5563059 req-fc8e7f82-724d-4489-8a55-3f56ba4d43c6 tempest-VolumesSnapshotTestJSON-1137680000 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3a0555a8-f248-41c2-b23f-fd458dbd282b', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '3a0555a8-f248-41c2-b23f-fd458dbd282b', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:31:16.606422 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-4b4f61a2-3b8c-4539-831f-0551c5563059 req-fc8e7f82-724d-4489-8a55-3f56ba4d43c6 tempest-VolumesSnapshotTestJSON-1137680000 None] Connection info returned from driver {'name': 'volumes/volume-3a0555a8-f248-41c2-b23f-fd458dbd282b', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3a0555a8-f248-41c2-b23f-fd458dbd282b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3eca69cb-7edd-4911-996e-c982edf41085'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:31:16.662467 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-4b4f61a2-3b8c-4539-831f-0551c5563059 req-fc8e7f82-724d-4489-8a55-3f56ba4d43c6 tempest-VolumesSnapshotTestJSON-1137680000 None] attachment_update completed successfully. Jul 30 21:31:18.972477 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c09de314-ea67-4b83-94af-b2d77830b615 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:31:19.702482 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c09de314-ea67-4b83-94af-b2d77830b615 tempest-VolumesSnapshotTestJSON-1137680000 None] Create snapshot completed successfully Jul 30 21:31:20.186272 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=72,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=14 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:20.201346 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f5d1bcea-1398-442f-8daf-2d1ef9eee651 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:31:20.702657 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f5d1bcea-1398-442f-8daf-2d1ef9eee651 tempest-VolumesSnapshotTestJSON-1137680000 None] Create snapshot completed successfully Jul 30 21:31:21.557040 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-314a6021-ae2f-4dc2-b3af-3f63600f5e0d tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:31:22.783848 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-314a6021-ae2f-4dc2-b3af-3f63600f5e0d tempest-VolumesSnapshotTestJSON-1137680000 None] Create snapshot completed successfully Jul 30 21:31:23.702153 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d1f82f09-e14d-49c0-85de-8e4958a0ab0f tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-62bf5d05-ccc3-415d-8738-eddf91d16a32-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:31:23.716586 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d1f82f09-e14d-49c0-85de-8e4958a0ab0f tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-62bf5d05-ccc3-415d-8738-eddf91d16a32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:31:23.736975 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d1f82f09-e14d-49c0-85de-8e4958a0ab0f tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:31:33.896560 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=61,cinder:UPDATE=13,cinder:INSERT=23,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:35.255553 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-099fc9b4-718c-45e8-bbfe-3cbc393a05c7 tempest-VolumesActionsTest-1001371749 None] Acquiring lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2" by "attach_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:31:35.265689 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-099fc9b4-718c-45e8-bbfe-3cbc393a05c7 tempest-VolumesActionsTest-1001371749 None] Lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2" acquired by "attach_volume" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:31:35.359050 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-099fc9b4-718c-45e8-bbfe-3cbc393a05c7 tempest-VolumesActionsTest-1001371749 None] Attaching volume 31fad2df-e2ec-4aaf-a07c-2338953ba6b2 to instance 78b2128f-7455-4215-a480-cc4345a10e17 at mountpoint /dev/sdb on host None. Jul 30 21:31:35.419269 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-099fc9b4-718c-45e8-bbfe-3cbc393a05c7 tempest-VolumesActionsTest-1001371749 None] Attach volume completed successfully. Jul 30 21:31:35.425354 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-099fc9b4-718c-45e8-bbfe-3cbc393a05c7 tempest-VolumesActionsTest-1001371749 None] Lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2" released by "attach_volume" :: held 0.160s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:31:35.781300 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8a699368-4dee-401e-a033-2a3a7294f66b tempest-VolumesActionsTest-1001371749 None] Acquiring lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-detach_volume" by "detach_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:31:35.803900 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8a699368-4dee-401e-a033-2a3a7294f66b tempest-VolumesActionsTest-1001371749 None] Lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:31:35.805508 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8a699368-4dee-401e-a033-2a3a7294f66b tempest-VolumesActionsTest-1001371749 None] Detaching volume 31fad2df-e2ec-4aaf-a07c-2338953ba6b2 from instance 78b2128f-7455-4215-a480-cc4345a10e17. Jul 30 21:31:35.862328 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8a699368-4dee-401e-a033-2a3a7294f66b tempest-VolumesActionsTest-1001371749 None] Detach volume completed successfully. Jul 30 21:31:35.871436 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8a699368-4dee-401e-a033-2a3a7294f66b tempest-VolumesActionsTest-1001371749 None] Lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:31:42.946276 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-337ad4fd-88cf-47a6-8ddb-ebab32c3ad2f tempest-VolumesActionsTest-1001371749 None] Running cmd (subprocess): rbd export --pool volumes volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2 /opt/stack/data/cinder/conversion/volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-71f27411-c7fe-4e93-b5a5-511590583a9d --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:31:44.363600 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-337ad4fd-88cf-47a6-8ddb-ebab32c3ad2f tempest-VolumesActionsTest-1001371749 None] CMD "rbd export --pool volumes volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2 /opt/stack/data/cinder/conversion/volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-71f27411-c7fe-4e93-b5a5-511590583a9d --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.417s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:31:44.374371 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.image_utils [None req-337ad4fd-88cf-47a6-8ddb-ebab32c3ad2f tempest-VolumesActionsTest-1001371749 None] 71f27411-c7fe-4e93-b5a5-511590583a9d was raw, no need to convert to raw {{(pid=124008) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}} Jul 30 21:31:53.901574 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=35,cinder:INSERT=15,cinder:DELETE=1,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:31:54.133471 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-d1f82f09-e14d-49c0-85de-8e4958a0ab0f tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['30b3d0d4-b7bf-4cd4-a976-34051140fdf4', 'dc276a70-4b36-4dcf-9b2a-5fd2b61e0d0f', '13575895-571d-4370-9abf-389a15b78652', 'f56b0d83-3a6b-47d8-a2f2-0328c5f7bef5'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:31:54.233053 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-d1f82f09-e14d-49c0-85de-8e4958a0ab0f tempest-VolumesSnapshotTestJSON-1137680000 None] Delete snapshot completed successfully. Jul 30 21:31:54.248670 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d1f82f09-e14d-49c0-85de-8e4958a0ab0f tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-62bf5d05-ccc3-415d-8738-eddf91d16a32-delete_snapshot" released by "delete_snapshot" :: held 30.532s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:31:54.527053 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-23bfcb77-7bcb-4a50-8587-7ffcec57cf3a tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-07dcf937-b49b-4608-b6be-f2e9e7820a45-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:31:54.579152 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-23bfcb77-7bcb-4a50-8587-7ffcec57cf3a tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-07dcf937-b49b-4608-b6be-f2e9e7820a45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:31:54.591799 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-23bfcb77-7bcb-4a50-8587-7ffcec57cf3a tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:31:57.835661 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-a18e1241-f838-4f2d-85da-049273368113 req-9fa0eb5d-0e15-4472-9784-ec6bceef2bb8 tempest-AttachVolumeTestJSON-1877777549 None] Terminate volume connection completed successfully. Jul 30 21:31:57.836357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a18e1241-f838-4f2d-85da-049273368113 req-9fa0eb5d-0e15-4472-9784-ec6bceef2bb8 tempest-AttachVolumeTestJSON-1877777549 None] Deleting attachment 9faec9a9-058e-4ed8-b31b-c0a3fa734996. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:32:13.306277 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-337ad4fd-88cf-47a6-8ddb-ebab32c3ad2f tempest-VolumesActionsTest-1001371749 None] Uploaded volume to glance image-id: 71f27411-c7fe-4e93-b5a5-511590583a9d. {{(pid=124008) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1791}} Jul 30 21:32:13.308652 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=26,cinder:UPDATE=14,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:13.329073 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-337ad4fd-88cf-47a6-8ddb-ebab32c3ad2f tempest-VolumesActionsTest-1001371749 None] Copy volume to image completed successfully. Jul 30 21:32:14.889799 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] Acquiring lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:32:14.929270 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] Lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:32:15.018542 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:15.128395 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:32:15.128854 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] Volume volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:32:15.146905 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] deleting rbd volume volume-31fad2df-e2ec-4aaf-a07c-2338953ba6b2 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:32:15.491835 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] Created reservations ['7becacb3-1940-434c-a529-a056285323fe', '0a1a2bfd-eea9-44af-a6bb-67036dad6657', '537bdd0f-fb64-46d4-873e-bf3fa593c515', '4d08c44e-20c1-49c6-ba40-e7bfd867b10b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:32:15.557572 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:15.613492 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:15.654063 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:32:15.666134 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] Deleted volume successfully. Jul 30 21:32:15.688755 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-465512a3-3599-486a-baed-de39d37b7618 tempest-VolumesActionsTest-1001371749 None] Lock "cinder-31fad2df-e2ec-4aaf-a07c-2338953ba6b2-delete_volume" released by "delete_volume" :: held 0.759s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:32:16.073958 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:32:16.074620 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:16.110775 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:16.147832 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:32:18.934666 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:32:18.956955 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Flow 'volume_create_manager' (fb519695-4458-4781-83db-6f06a1982573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:32:18.963504 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4aa3b4-465e-4506-8080-516ae13f6569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:18.980268 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4aa3b4-465e-4506-8080-516ae13f6569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1509540139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d83d9a53-4523-48b8-96ac-369aca869db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b1716d1241449ea378b184fcd95729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:32:19Z,use_quota=True,user_id='a2645fa8ca13490bb0c23aad8c73de3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:18.985508 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4043a0c7-ac95-4a79-8a22-02717be6173d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:18.990115 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4043a0c7-ac95-4a79-8a22-02717be6173d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:18.995364 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c3ba6a-8fe1-4a0f-8d28-8aee91c1895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:18.999641 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c3ba6a-8fe1-4a0f-8d28-8aee91c1895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83d9a53-4523-48b8-96ac-369aca869db0', 'volume_name': 'volume-d83d9a53-4523-48b8-96ac-369aca869db0', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:19.017384 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f650f7-ae48-4890-a6ab-2f476d6f7a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:19.021565 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f650f7-ae48-4890-a6ab-2f476d6f7a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:19.026281 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf2b394-5ad5-45a6-9628-d8dd99261d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:19.027415 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Volume d83d9a53-4523-48b8-96ac-369aca869db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83d9a53-4523-48b8-96ac-369aca869db0', 'volume_size': 1} Jul 30 21:32:19.027817 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] creating volume 'volume-d83d9a53-4523-48b8-96ac-369aca869db0' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:32:19.028782 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:19.108974 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:32:19.109281 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:32:19.113132 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf2b394-5ad5-45a6-9628-d8dd99261d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83d9a53-4523-48b8-96ac-369aca869db0', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:19.118847 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261e4ad2-4ca0-4432-8170-a698fc9570a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:19.129241 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Volume volume-d83d9a53-4523-48b8-96ac-369aca869db0 (d83d9a53-4523-48b8-96ac-369aca869db0): created successfully Jul 30 21:32:19.133581 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261e4ad2-4ca0-4432-8170-a698fc9570a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:19.139183 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Flow 'volume_create_manager' (fb519695-4458-4781-83db-6f06a1982573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:32:19.149981 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-aa7e51dd-7d3f-4608-bb93-4e554a2b3024 tempest-VolumesBackupsTest-2039384880 None] Created volume successfully. Jul 30 21:32:24.886894 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=27,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:24.958854 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-23bfcb77-7bcb-4a50-8587-7ffcec57cf3a tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['e35c0fe8-0059-49f5-a0e8-6346e006ece6', '031c6c34-85ee-4036-afba-5e7c12abf462', '104b9c74-faf7-44e7-89ce-7852098dfb79', '8ba25be2-715d-4b15-9891-7a355acde3fd'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:32:25.006151 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-23bfcb77-7bcb-4a50-8587-7ffcec57cf3a tempest-VolumesSnapshotTestJSON-1137680000 None] Delete snapshot completed successfully. Jul 30 21:32:25.011825 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-23bfcb77-7bcb-4a50-8587-7ffcec57cf3a tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-07dcf937-b49b-4608-b6be-f2e9e7820a45-delete_snapshot" released by "delete_snapshot" :: held 30.433s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:32:25.219987 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-de9ac018-82d2-40c4-8f50-8d97c18d9c2d tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-7fb029b4-5dab-4a03-aec1-1078ee08b4ec-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:32:25.232298 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-de9ac018-82d2-40c4-8f50-8d97c18d9c2d tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-7fb029b4-5dab-4a03-aec1-1078ee08b4ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:32:25.234129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-de9ac018-82d2-40c4-8f50-8d97c18d9c2d tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:33.902506 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-3245a101-9867-43b9-a8be-bec28fa0fb9a req-d7cfcb5c-a165-40a8-8812-6d5eb5aa7410 tempest-VolumesBackupsTest-2039384880 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:32:35.230102 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-3245a101-9867-43b9-a8be-bec28fa0fb9a req-d7cfcb5c-a165-40a8-8812-6d5eb5aa7410 tempest-VolumesBackupsTest-2039384880 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.327s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:32:35.230932 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-3245a101-9867-43b9-a8be-bec28fa0fb9a req-d7cfcb5c-a165-40a8-8812-6d5eb5aa7410 tempest-VolumesBackupsTest-2039384880 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d83d9a53-4523-48b8-96ac-369aca869db0', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'd83d9a53-4523-48b8-96ac-369aca869db0', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:32:35.261719 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-3245a101-9867-43b9-a8be-bec28fa0fb9a req-d7cfcb5c-a165-40a8-8812-6d5eb5aa7410 tempest-VolumesBackupsTest-2039384880 None] Connection info returned from driver {'name': 'volumes/volume-d83d9a53-4523-48b8-96ac-369aca869db0', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd83d9a53-4523-48b8-96ac-369aca869db0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '569e9666-c8a5-46a9-91aa-80041742e738'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:32:35.334297 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-3245a101-9867-43b9-a8be-bec28fa0fb9a req-d7cfcb5c-a165-40a8-8812-6d5eb5aa7410 tempest-VolumesBackupsTest-2039384880 None] attachment_update completed successfully. Jul 30 21:32:37.438219 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5de8358e-5de1-4e6b-a589-1c7169eeed18 tempest-VolumesBackupsTest-2039384880 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-30T21:32:37Z,data_timestamp=2022-07-30T21:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-727829600',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=0983339c-762c-42e9-a1ef-42362e104003,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d4b1716d1241449ea378b184fcd95729',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a2645fa8ca13490bb0c23aad8c73de3f',volume_id=d83d9a53-4523-48b8-96ac-369aca869db0) Jul 30 21:32:37.450034 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.backup.rpcapi [None req-5de8358e-5de1-4e6b-a589-1c7169eeed18 tempest-VolumesBackupsTest-2039384880 None] continue_backup in rpcapi backup_id 0983339c-762c-42e9-a1ef-42362e104003 {{(pid=124008) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jul 30 21:32:37.685482 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-5de8358e-5de1-4e6b-a589-1c7169eeed18 tempest-VolumesBackupsTest-2039384880 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:32:39.043856 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-5de8358e-5de1-4e6b-a589-1c7169eeed18 tempest-VolumesBackupsTest-2039384880 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.358s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:32:39.045056 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5de8358e-5de1-4e6b-a589-1c7169eeed18 tempest-VolumesBackupsTest-2039384880 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d83d9a53-4523-48b8-96ac-369aca869db0', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'd83d9a53-4523-48b8-96ac-369aca869db0', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:32:39.063749 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5de8358e-5de1-4e6b-a589-1c7169eeed18 tempest-VolumesBackupsTest-2039384880 None] Initialize volume connection completed successfully. Jul 30 21:32:41.298207 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5de8358e-5de1-4e6b-a589-1c7169eeed18 tempest-VolumesBackupsTest-2039384880 None] Terminate volume connection completed successfully. Jul 30 21:32:41.317455 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5de8358e-5de1-4e6b-a589-1c7169eeed18 tempest-VolumesBackupsTest-2039384880 None] Remove volume export completed successfully. Jul 30 21:32:43.933605 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=58,cinder:INSERT=2,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:44.767951 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-fca581b9-9e2e-472e-96f2-ed7238527dec req-3023f0f7-6880-44d2-8c85-02e04fd6152f tempest-VolumesBackupsTest-2039384880 None] Terminate volume connection completed successfully. Jul 30 21:32:44.768463 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-fca581b9-9e2e-472e-96f2-ed7238527dec req-3023f0f7-6880-44d2-8c85-02e04fd6152f tempest-VolumesBackupsTest-2039384880 None] Deleting attachment 569e9666-c8a5-46a9-91aa-80041742e738. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:32:47.971482 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] Acquiring lock "cinder-d83d9a53-4523-48b8-96ac-369aca869db0-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:32:47.983716 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] Lock "cinder-d83d9a53-4523-48b8-96ac-369aca869db0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:32:48.025646 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:48.734185 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] Volume volume-d83d9a53-4523-48b8-96ac-369aca869db0 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:32:48.748381 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] deleting rbd volume volume-d83d9a53-4523-48b8-96ac-369aca869db0 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:32:48.970347 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] Created reservations ['8241a8ba-9b1c-4fe2-b52d-bd3d1a27737d', 'ea01c3e3-0326-41f1-9d35-fe25299b68b7', 'e8bfec99-b15f-4548-adfd-d4ab3a977b32', '820a855b-5bfc-4eec-b75e-3ce7dd1a3db9'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:32:49.019061 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:49.087379 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:49.126290 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:32:49.131536 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] Deleted volume successfully. Jul 30 21:32:49.149160 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3c649620-7dda-4df4-820a-60280acfb4b1 tempest-VolumesBackupsTest-2039384880 None] Lock "cinder-d83d9a53-4523-48b8-96ac-369aca869db0-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:32:49.628205 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:32:49.647725 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Flow 'volume_create_manager' (dbc76a61-47be-49cf-b254-1bb2e29c63f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:32:49.654106 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a501c2e0-9299-4aad-9005-710d2a0a5379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:49.670785 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a501c2e0-9299-4aad-9005-710d2a0a5379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-756914622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3e3021e-ddd7-468d-94eb-4e644d7d07d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b1716d1241449ea378b184fcd95729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:32:50Z,use_quota=True,user_id='a2645fa8ca13490bb0c23aad8c73de3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:49.675933 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874d0092-23a1-4fe6-bc42-d0fc63dd63c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:49.679927 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874d0092-23a1-4fe6-bc42-d0fc63dd63c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:49.684845 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605f05ed-d2f7-4a4a-a1af-1765be2ffab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:49.770148 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605f05ed-d2f7-4a4a-a1af-1765be2ffab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3e3021e-ddd7-468d-94eb-4e644d7d07d2', 'volume_name': 'volume-f3e3021e-ddd7-468d-94eb-4e644d7d07d2', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:49.775175 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d969b4-8947-4368-a3e2-b72b3b884f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:49.779079 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d969b4-8947-4368-a3e2-b72b3b884f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:49.783744 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c8aa07-91cf-4c6c-b3a6-fa57af76db6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:49.784855 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Volume f3e3021e-ddd7-468d-94eb-4e644d7d07d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3e3021e-ddd7-468d-94eb-4e644d7d07d2', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:32:49.785422 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Cloning f3e3021e-ddd7-468d-94eb-4e644d7d07d2 from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:32:49.786157 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:32:49.796343 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:32:49.805546 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 32, 49, 800395)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:32:49.805973 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:32:49.806363 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:32:49.811387 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:32:49.812346 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:32:49.818580 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 32, 49, 816341)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:32:49.818986 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:32:49.819400 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:32:49.833065 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:32:49.880614 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] creating snapshot='volume-f3e3021e-ddd7-468d-94eb-4e644d7d07d2.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:32:50.768561 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-f3e3021e-ddd7-468d-94eb-4e644d7d07d2.clone_snap' to 'volume-f3e3021e-ddd7-468d-94eb-4e644d7d07d2' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:32:50.895576 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:32:50.896949 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:32:50.897320 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:32:50.917793 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:32:50.918423 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Marking volume f3e3021e-ddd7-468d-94eb-4e644d7d07d2 as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:32:50.926604 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to f3e3021e-ddd7-468d-94eb-4e644d7d07d2. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:32:50.927271 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Creating volume glance metadata for volume f3e3021e-ddd7-468d-94eb-4e644d7d07d2 backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:32:50.988066 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c8aa07-91cf-4c6c-b3a6-fa57af76db6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e3021e-ddd7-468d-94eb-4e644d7d07d2', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:50.993057 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db40afe5-61da-4ca4-878c-24951b882dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:32:51.005031 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Volume volume-f3e3021e-ddd7-468d-94eb-4e644d7d07d2 (f3e3021e-ddd7-468d-94eb-4e644d7d07d2): created successfully Jul 30 21:32:51.008866 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db40afe5-61da-4ca4-878c-24951b882dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:32:51.014237 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Flow 'volume_create_manager' (dbc76a61-47be-49cf-b254-1bb2e29c63f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:32:51.024914 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b5af2407-dc23-4c0e-8bf2-c32424ccf615 tempest-VolumesBackupsTest-2039384880 None] Created volume successfully. Jul 30 21:32:51.966029 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-49f6babb-19c2-4b17-852e-2e4831e1f7a9 tempest-VolumesBackupsTest-2039384880 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-07-30T21:32:51Z,data_timestamp=2022-07-30T21:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1335751332',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=0cb032d2-f0e6-486e-94cf-8d8c4dba4967,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d4b1716d1241449ea378b184fcd95729',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a2645fa8ca13490bb0c23aad8c73de3f',volume_id=f3e3021e-ddd7-468d-94eb-4e644d7d07d2) Jul 30 21:32:51.966802 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.backup.rpcapi [None req-49f6babb-19c2-4b17-852e-2e4831e1f7a9 tempest-VolumesBackupsTest-2039384880 None] continue_backup in rpcapi backup_id 0cb032d2-f0e6-486e-94cf-8d8c4dba4967 {{(pid=124008) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jul 30 21:32:52.070799 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-49f6babb-19c2-4b17-852e-2e4831e1f7a9 tempest-VolumesBackupsTest-2039384880 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:32:52.897928 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-49f6babb-19c2-4b17-852e-2e4831e1f7a9 tempest-VolumesBackupsTest-2039384880 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.827s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:32:52.898953 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-49f6babb-19c2-4b17-852e-2e4831e1f7a9 tempest-VolumesBackupsTest-2039384880 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f3e3021e-ddd7-468d-94eb-4e644d7d07d2', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'f3e3021e-ddd7-468d-94eb-4e644d7d07d2', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:32:52.915281 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-49f6babb-19c2-4b17-852e-2e4831e1f7a9 tempest-VolumesBackupsTest-2039384880 None] Initialize volume connection completed successfully. Jul 30 21:32:55.710944 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:INSERT=12,cinder:SELECT=62,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:32:55.809788 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-de9ac018-82d2-40c4-8f50-8d97c18d9c2d tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['0c1e7a32-4ee0-46e7-bfe7-8fb1bf661312', '5e852109-616d-4cdc-9885-099c5fc09115', '68843db8-ac58-43da-b76b-7ac431c461b9', '0be13775-beb1-4ae0-8354-d210736f3ce7'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:32:55.891688 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-de9ac018-82d2-40c4-8f50-8d97c18d9c2d tempest-VolumesSnapshotTestJSON-1137680000 None] Delete snapshot completed successfully. Jul 30 21:32:55.902833 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-de9ac018-82d2-40c4-8f50-8d97c18d9c2d tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-7fb029b4-5dab-4a03-aec1-1078ee08b4ec-delete_snapshot" released by "delete_snapshot" :: held 30.670s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:32:57.759218 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-350693a5-3a4e-4827-a5ec-b0c2757efe91 req-71d06293-c911-418c-89fb-e6aef7cd8879 tempest-VolumesSnapshotTestJSON-1137680000 None] Terminate volume connection completed successfully. Jul 30 21:32:57.759938 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-350693a5-3a4e-4827-a5ec-b0c2757efe91 req-71d06293-c911-418c-89fb-e6aef7cd8879 tempest-VolumesSnapshotTestJSON-1137680000 None] Deleting attachment 3eca69cb-7edd-4911-996e-c982edf41085. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:33:01.340351 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-49f6babb-19c2-4b17-852e-2e4831e1f7a9 tempest-VolumesBackupsTest-2039384880 None] Terminate volume connection completed successfully. Jul 30 21:33:01.363275 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-49f6babb-19c2-4b17-852e-2e4831e1f7a9 tempest-VolumesBackupsTest-2039384880 None] Remove volume export completed successfully. Jul 30 21:33:02.604695 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c342d88a-c014-424b-8424-016ad4304e8e tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:02.758077 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:33:02.780180 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Flow 'volume_create_manager' (36620437-5b98-4601-ad00-88cd9ed90762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:33:02.786606 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6f898a-312b-497b-8a25-bace91ec0d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:02.802507 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6f898a-312b-497b-8a25-bace91ec0d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:33:03Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_0cb032d2-f0e6-486e-94cf-8d8c4dba4967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d8cf4016-53f6-484b-9af7-5ee697a3555a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b1716d1241449ea378b184fcd95729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:33:03Z,use_quota=True,user_id='a2645fa8ca13490bb0c23aad8c73de3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:02.807718 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ee14d0-7948-4011-83ba-4c24ec424656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:02.811752 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ee14d0-7948-4011-83ba-4c24ec424656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:02.817493 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41fafa8-a011-4dce-8fc9-f5e3f1fdff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:02.821456 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41fafa8-a011-4dce-8fc9-f5e3f1fdff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8cf4016-53f6-484b-9af7-5ee697a3555a', 'volume_name': 'volume-d8cf4016-53f6-484b-9af7-5ee697a3555a', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:02.826196 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9872d8af-e678-4b83-8797-45e68eea7ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:02.830010 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9872d8af-e678-4b83-8797-45e68eea7ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:02.835253 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16755ad3-04d5-4afb-bc35-e3579490a32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:02.836337 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Volume d8cf4016-53f6-484b-9af7-5ee697a3555a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8cf4016-53f6-484b-9af7-5ee697a3555a', 'volume_size': 1} Jul 30 21:33:02.836746 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] creating volume 'volume-d8cf4016-53f6-484b-9af7-5ee697a3555a' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:33:02.837518 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:02.891560 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:33:02.891952 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:33:02.896285 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16755ad3-04d5-4afb-bc35-e3579490a32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8cf4016-53f6-484b-9af7-5ee697a3555a', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:02.900669 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af6b1df-4ca4-4ea7-8f91-b2373840fa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:02.910440 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Volume volume-d8cf4016-53f6-484b-9af7-5ee697a3555a (d8cf4016-53f6-484b-9af7-5ee697a3555a): created successfully Jul 30 21:33:02.914046 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af6b1df-4ca4-4ea7-8f91-b2373840fa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:02.919429 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Flow 'volume_create_manager' (36620437-5b98-4601-ad00-88cd9ed90762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:33:02.929583 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Created volume successfully. Jul 30 21:33:03.089935 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c342d88a-c014-424b-8424-016ad4304e8e tempest-VolumesSnapshotTestJSON-1137680000 None] Create snapshot completed successfully Jul 30 21:33:03.826138 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bd7b69d5-8661-4920-993e-363e5a20d9c1 tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-17ec1804-f52c-4e9a-bee6-316aaaec6e5a-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:33:03.844101 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:33:03.867728 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bd7b69d5-8661-4920-993e-363e5a20d9c1 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-17ec1804-f52c-4e9a-bee6-316aaaec6e5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:33:03.870032 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bd7b69d5-8661-4920-993e-363e5a20d9c1 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:04.153594 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=66,cinder:UPDATE=21,cinder:INSERT=12,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:04.159902 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-bd7b69d5-8661-4920-993e-363e5a20d9c1 tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['9ee9ce92-5a81-406a-b553-f721d16f7a4c', '283bdbc7-0fbe-455d-9982-37a7ac2da36e', 'e3ae2c4f-3ba8-4318-b375-de9102bbd440', 'ef419b2d-b56b-474c-a208-49229d46c226'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:33:04.198679 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bd7b69d5-8661-4920-993e-363e5a20d9c1 tempest-VolumesSnapshotTestJSON-1137680000 None] Delete snapshot completed successfully. Jul 30 21:33:04.203671 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bd7b69d5-8661-4920-993e-363e5a20d9c1 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-17ec1804-f52c-4e9a-bee6-316aaaec6e5a-delete_snapshot" released by "delete_snapshot" :: held 0.336s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:33:04.639863 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.796s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:33:04.640611 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d8cf4016-53f6-484b-9af7-5ee697a3555a', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'd8cf4016-53f6-484b-9af7-5ee697a3555a', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:33:04.653685 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Initialize volume connection completed successfully. Jul 30 21:33:05.194957 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-53c91008-ecfb-4fb6-9cb0-6d072e6fc18a tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:06.017070 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-53c91008-ecfb-4fb6-9cb0-6d072e6fc18a tempest-VolumesSnapshotTestJSON-1137680000 None] Create snapshot completed successfully Jul 30 21:33:08.563206 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Terminate volume connection completed successfully. Jul 30 21:33:08.583149 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b796d883-ede7-4619-8a2f-2f40a7c3b1b9 tempest-VolumesBackupsTest-2039384880 None] Remove volume export completed successfully. Jul 30 21:33:09.152898 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] Acquiring lock "cinder-d8cf4016-53f6-484b-9af7-5ee697a3555a-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:33:09.169276 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] Lock "cinder-d8cf4016-53f6-484b-9af7-5ee697a3555a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:33:09.204917 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:10.252552 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] Volume volume-d8cf4016-53f6-484b-9af7-5ee697a3555a is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:33:10.273389 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] deleting rbd volume volume-d8cf4016-53f6-484b-9af7-5ee697a3555a {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:33:10.641116 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] Created reservations ['e1b63a0d-9cc2-408a-9f0e-9ee4158de060', '91acfa4e-3ff6-43b6-99d4-e808ebc58c12', '098098b5-ff4a-406c-93b5-4391b504c705', 'ac76f8cf-717c-4e0e-8893-91b4d8b5f372'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:33:10.689916 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:10.722961 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:10.754604 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:33:10.768878 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] Deleted volume successfully. Jul 30 21:33:10.788178 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-c70cf098-6657-49f6-af4c-b7df167e096d tempest-VolumesBackupsTest-2039384880 None] Lock "cinder-d8cf4016-53f6-484b-9af7-5ee697a3555a-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:33:13.532752 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] Acquiring lock "cinder-f3e3021e-ddd7-468d-94eb-4e644d7d07d2-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:33:13.549478 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] Lock "cinder-f3e3021e-ddd7-468d-94eb-4e644d7d07d2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:33:13.591024 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:14.289499 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] deleting rbd volume volume-f3e3021e-ddd7-468d-94eb-4e644d7d07d2 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:33:14.441860 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:33:14.474257 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] deleting parent snapshot volume-f3e3021e-ddd7-468d-94eb-4e644d7d07d2.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:33:15.378715 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] Created reservations ['9055d5db-f90c-45c4-b181-fa4b63dbe9c3', '2bc1b3e3-4428-453f-90ca-42d6678ec727', 'aacac721-3c96-42b2-915e-7097ac0f11d5', 'dc5bb2f9-3604-4df0-b716-4c4b03542ed6'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:33:15.409262 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=61,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:15.430390 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:15.456045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:15.480419 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:33:15.485357 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] Deleted volume successfully. Jul 30 21:33:15.496516 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-dc3e88c5-b8b7-4ecf-b097-148f938cbe73 tempest-VolumesBackupsTest-2039384880 None] Lock "cinder-f3e3021e-ddd7-468d-94eb-4e644d7d07d2-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:33:16.072355 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:33:16.073081 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:16.112600 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:16.141079 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:33:17.921860 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:33:17.945957 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Flow 'volume_create_manager' (93dd6df8-edf4-4009-bf24-c456544eb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:33:17.952887 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db392030-f7ce-4d81-8bb6-8ccf3b80ef6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:17.970004 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db392030-f7ce-4d81-8bb6-8ccf3b80ef6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-450241810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c38d5cb3-359a-43fe-bd8b-21129457bf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ba35de01ed47319a705e24dba68004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:33:18Z,use_quota=True,user_id='d063b0dbdbec45298341b79d47981a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:17.976102 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21f1241-4a88-4025-9505-609de0a02c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:17.980486 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21f1241-4a88-4025-9505-609de0a02c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:17.985425 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870a8800-471c-4b51-96f4-72e2c6ef2183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:18.079778 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870a8800-471c-4b51-96f4-72e2c6ef2183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c38d5cb3-359a-43fe-bd8b-21129457bf3b', 'volume_name': 'volume-c38d5cb3-359a-43fe-bd8b-21129457bf3b', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:18.085328 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb29465-05a5-468a-8d64-4f88dbe81686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:18.089254 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb29465-05a5-468a-8d64-4f88dbe81686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:18.094075 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7830e84-e6f7-4922-9f58-e794c9b5929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:18.095278 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Volume c38d5cb3-359a-43fe-bd8b-21129457bf3b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c38d5cb3-359a-43fe-bd8b-21129457bf3b', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:33:18.096641 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Cloning c38d5cb3-359a-43fe-bd8b-21129457bf3b from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:33:18.097377 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:33:18.108335 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:33:18.120162 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 33, 18, 113956)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:33:18.120889 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:33:18.121496 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:33:18.127506 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:33:18.128474 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:33:18.134500 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 33, 18, 131990)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:33:18.134968 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:33:18.135421 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:33:18.148469 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:18.218945 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] creating snapshot='volume-c38d5cb3-359a-43fe-bd8b-21129457bf3b.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:33:18.335276 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-c38d5cb3-359a-43fe-bd8b-21129457bf3b.clone_snap' to 'volume-c38d5cb3-359a-43fe-bd8b-21129457bf3b' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:33:18.455141 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:33:18.456274 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:33:18.456670 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:33:18.471264 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:33:18.471954 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Marking volume c38d5cb3-359a-43fe-bd8b-21129457bf3b as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:33:18.479591 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to c38d5cb3-359a-43fe-bd8b-21129457bf3b. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:33:18.480011 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Creating volume glance metadata for volume c38d5cb3-359a-43fe-bd8b-21129457bf3b backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:33:18.533601 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7830e84-e6f7-4922-9f58-e794c9b5929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c38d5cb3-359a-43fe-bd8b-21129457bf3b', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:18.538254 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013bb44d-9c9b-4c85-b2e6-3b59ee1fe639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:18.546762 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Volume volume-c38d5cb3-359a-43fe-bd8b-21129457bf3b (c38d5cb3-359a-43fe-bd8b-21129457bf3b): created successfully Jul 30 21:33:18.551038 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013bb44d-9c9b-4c85-b2e6-3b59ee1fe639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:18.556645 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Flow 'volume_create_manager' (93dd6df8-edf4-4009-bf24-c456544eb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:33:18.564541 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-4abf3d58-9dbd-4077-935b-abfd3c858ec0 tempest-VolumesExtendTest-1765191497 None] Created volume successfully. Jul 30 21:33:19.103134 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8e8eae69-3b85-4cef-bde4-437e55c24be8 tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:19.255780 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8e8eae69-3b85-4cef-bde4-437e55c24be8 tempest-VolumesExtendTest-1765191497 None] Extend volume from 1 GB to 2 GB. {{(pid=124008) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}} Jul 30 21:33:19.270770 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=57,cinder:UPDATE=31,cinder:DELETE=1,cinder:INSERT=11 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:19.288505 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8e8eae69-3b85-4cef-bde4-437e55c24be8 tempest-VolumesExtendTest-1765191497 None] Extend volume completed successfully. Jul 30 21:33:20.195083 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-7bd99fed-d520-4b9d-894c-96266d27a19b req-5bbff8ee-01e6-46f7-9936-f640acd561b0 tempest-VolumesSnapshotTestJSON-1137680000 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:33:20.653497 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:33:20.681183 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Flow 'volume_create_manager' (855a2066-833d-4e81-9d58-8a67a7e9e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:33:20.694342 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923a1f96-e316-4c80-9df3-c9b9a6ba94a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:20.719732 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923a1f96-e316-4c80-9df3-c9b9a6ba94a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-132782242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=09b8ad70-2295-4552-ad4e-40aec0899ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ba35de01ed47319a705e24dba68004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:33:21Z,use_quota=True,user_id='d063b0dbdbec45298341b79d47981a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:20.725934 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5145434a-8041-46d4-8281-eaf05169a9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:20.731509 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5145434a-8041-46d4-8281-eaf05169a9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:20.737839 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6fda54-74c7-4ac9-ab70-be0fc3dfd500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:20.742614 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6fda54-74c7-4ac9-ab70-be0fc3dfd500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b8ad70-2295-4552-ad4e-40aec0899ac4', 'volume_name': 'volume-09b8ad70-2295-4552-ad4e-40aec0899ac4', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:20.748339 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9031c745-de0a-42d6-a0a4-2bcfbd423d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:20.753893 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9031c745-de0a-42d6-a0a4-2bcfbd423d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:20.759342 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d7b6c4-5541-4e21-af6c-18a56b80cc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:20.761135 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Volume 09b8ad70-2295-4552-ad4e-40aec0899ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b8ad70-2295-4552-ad4e-40aec0899ac4', 'volume_size': 1} Jul 30 21:33:20.761807 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] creating volume 'volume-09b8ad70-2295-4552-ad4e-40aec0899ac4' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:33:20.763032 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:20.839572 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:33:20.840167 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:33:20.844287 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d7b6c4-5541-4e21-af6c-18a56b80cc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b8ad70-2295-4552-ad4e-40aec0899ac4', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:20.849334 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349bd365-3f5b-442b-b383-18c1ff6e2fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:20.859457 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Volume volume-09b8ad70-2295-4552-ad4e-40aec0899ac4 (09b8ad70-2295-4552-ad4e-40aec0899ac4): created successfully Jul 30 21:33:20.863661 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349bd365-3f5b-442b-b383-18c1ff6e2fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:20.869082 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Flow 'volume_create_manager' (855a2066-833d-4e81-9d58-8a67a7e9e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:33:20.878842 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-22e7d931-d41b-4a84-9dc2-6eae5a861202 tempest-VolumesExtendTest-1765191497 None] Created volume successfully. Jul 30 21:33:21.149988 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-7bd99fed-d520-4b9d-894c-96266d27a19b req-5bbff8ee-01e6-46f7-9936-f640acd561b0 tempest-VolumesSnapshotTestJSON-1137680000 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.955s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:33:21.150804 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7bd99fed-d520-4b9d-894c-96266d27a19b req-5bbff8ee-01e6-46f7-9936-f640acd561b0 tempest-VolumesSnapshotTestJSON-1137680000 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-629d4006-7b40-4644-8678-fd6e4b6063f7', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '629d4006-7b40-4644-8678-fd6e4b6063f7', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:33:21.174006 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-7bd99fed-d520-4b9d-894c-96266d27a19b req-5bbff8ee-01e6-46f7-9936-f640acd561b0 tempest-VolumesSnapshotTestJSON-1137680000 None] Connection info returned from driver {'name': 'volumes/volume-629d4006-7b40-4644-8678-fd6e4b6063f7', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '629d4006-7b40-4644-8678-fd6e4b6063f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '79ae3de0-b64d-424a-a84c-78e065e87054'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:33:21.221737 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-7bd99fed-d520-4b9d-894c-96266d27a19b req-5bbff8ee-01e6-46f7-9936-f640acd561b0 tempest-VolumesSnapshotTestJSON-1137680000 None] attachment_update completed successfully. Jul 30 21:33:21.834954 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9fd3d158-f00e-4458-a147-6fc2651b485d tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:22.830159 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-9fd3d158-f00e-4458-a147-6fc2651b485d tempest-VolumesExtendTest-1765191497 None] Create snapshot completed successfully Jul 30 21:33:23.516450 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7a9ea90e-5c8b-43c9-9f3e-637fae253ebc tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:23.840657 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-7a9ea90e-5c8b-43c9-9f3e-637fae253ebc tempest-VolumesSnapshotTestJSON-1137680000 None] Create snapshot completed successfully Jul 30 21:33:24.005992 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-234cc809-2b0b-4248-b851-e025f5c97f59 tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:24.096100 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-234cc809-2b0b-4248-b851-e025f5c97f59 tempest-VolumesExtendTest-1765191497 None] Extend volume from 1 GB to 2 GB. {{(pid=124008) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}} Jul 30 21:33:24.124822 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-234cc809-2b0b-4248-b851-e025f5c97f59 tempest-VolumesExtendTest-1765191497 None] Extend volume completed successfully. Jul 30 21:33:24.764821 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-aec90006-dcf8-4cdb-bd61-f76002d82a3e tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:25.203665 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-86cac800-664b-4246-8ad3-bcf504d27735 tempest-VolumesExtendTest-1765191497 None] Acquiring lock "cinder-cca6de08-f1c4-4796-87ee-d45c932bca48-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:33:25.214658 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-86cac800-664b-4246-8ad3-bcf504d27735 tempest-VolumesExtendTest-1765191497 None] Lock "cinder-cca6de08-f1c4-4796-87ee-d45c932bca48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:33:25.217169 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-86cac800-664b-4246-8ad3-bcf504d27735 tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:25.839136 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-aec90006-dcf8-4cdb-bd61-f76002d82a3e tempest-VolumesSnapshotTestJSON-1137680000 None] Create snapshot completed successfully Jul 30 21:33:25.859590 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-86cac800-664b-4246-8ad3-bcf504d27735 tempest-VolumesExtendTest-1765191497 None] Created reservations ['afdb60a0-5312-4e1c-a78f-f10913f0ad84', '5bd2486e-67d1-4a0d-85eb-cd02e1fa4a32', '8f05302b-dc53-4f9d-ad83-345217568870', '907dd3a5-c9c9-4d7f-abaf-6aa66c3a2619'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:33:25.897011 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-86cac800-664b-4246-8ad3-bcf504d27735 tempest-VolumesExtendTest-1765191497 None] Delete snapshot completed successfully. Jul 30 21:33:25.901791 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-86cac800-664b-4246-8ad3-bcf504d27735 tempest-VolumesExtendTest-1765191497 None] Lock "cinder-cca6de08-f1c4-4796-87ee-d45c932bca48-delete_snapshot" released by "delete_snapshot" :: held 0.687s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:33:26.305205 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] Acquiring lock "cinder-09b8ad70-2295-4552-ad4e-40aec0899ac4-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:33:26.327830 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] Lock "cinder-09b8ad70-2295-4552-ad4e-40aec0899ac4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:33:26.370851 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:26.412435 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:33:26.413000 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] Volume volume-09b8ad70-2295-4552-ad4e-40aec0899ac4 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:33:26.417310 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] deleting rbd volume volume-09b8ad70-2295-4552-ad4e-40aec0899ac4 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:33:26.605043 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] Created reservations ['3b211a83-b0a2-4657-8217-617182e52886', '344cb5bf-a170-4490-adcd-c550d6b6422b', '92f84c80-410c-42d9-bfde-fb1e5f93c2a1', '12a5c52a-7da8-49ed-a0e8-5d246c74d97b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:33:26.616717 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:DELETE=4,cinder:SELECT=69,cinder:UPDATE=19,cinder:INSERT=8 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:26.656321 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:26.686171 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:26.717708 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:33:26.722901 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] Deleted volume successfully. Jul 30 21:33:26.743673 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-d4fd99b1-382a-4f79-97ca-c64542adcea9 tempest-VolumesExtendTest-1765191497 None] Lock "cinder-09b8ad70-2295-4552-ad4e-40aec0899ac4-delete_volume" released by "delete_volume" :: held 0.416s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:33:26.864646 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-10761a0e-7afc-4d88-9589-cd05ce05d1f7 tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-1011da42-668f-49a3-848d-550c58d239af-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:33:26.876457 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-10761a0e-7afc-4d88-9589-cd05ce05d1f7 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-1011da42-668f-49a3-848d-550c58d239af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:33:26.878355 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-10761a0e-7afc-4d88-9589-cd05ce05d1f7 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:27.450373 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] Acquiring lock "cinder-c38d5cb3-359a-43fe-bd8b-21129457bf3b-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:33:27.460491 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] Lock "cinder-c38d5cb3-359a-43fe-bd8b-21129457bf3b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:33:27.493886 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:27.559989 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:33:27.569074 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] deleting rbd volume volume-c38d5cb3-359a-43fe-bd8b-21129457bf3b {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:33:27.704580 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:33:27.731042 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] deleting parent snapshot volume-c38d5cb3-359a-43fe-bd8b-21129457bf3b.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:33:27.870725 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=66,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=6 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:27.881464 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] Created reservations ['b4907e9b-5802-4c31-badf-f5f9030c459c', '66a3606d-4f1a-43ae-bfbf-cc04f8f8a9c6', 'f9ab17b0-6480-4446-b868-e032dd70135d', '2155851f-0e5e-44df-8899-db4bed8a3f1a'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:33:27.929837 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:27.952618 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:27.975711 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:33:27.980568 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] Deleted volume successfully. Jul 30 21:33:27.993541 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-97f0f05f-fc7a-4480-8fe6-9c27fb55d5cf tempest-VolumesExtendTest-1765191497 None] Lock "cinder-c38d5cb3-359a-43fe-bd8b-21129457bf3b-delete_volume" released by "delete_volume" :: held 0.533s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:33:44.305295 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:46.788094 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:33:46.808159 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Flow 'volume_create_manager' (c1aed6f3-a0e0-4868-b952-8ae22ec24c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:33:46.814857 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c3dbfa-1314-4f6c-9c0e-743f207e77c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:46.836378 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c3dbfa-1314-4f6c-9c0e-743f207e77c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1790159914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44d7e113-0b68-4b4b-bd08-160ac4fe0c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7b4209e06447d5abdff867f9a7adce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:33:47Z,use_quota=True,user_id='5a6da0171fac41fb934ed2b294081531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:46.842559 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1957ca-e86f-4d0e-b325-b481737d8d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:46.846758 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1957ca-e86f-4d0e-b325-b481737d8d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:46.851864 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b62beed-106f-4d6e-8cc4-35d3073695c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:46.855941 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b62beed-106f-4d6e-8cc4-35d3073695c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d7e113-0b68-4b4b-bd08-160ac4fe0c50', 'volume_name': 'volume-44d7e113-0b68-4b4b-bd08-160ac4fe0c50', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:46.860616 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e214026-58cc-417c-994e-56fc47a0ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:46.864431 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e214026-58cc-417c-994e-56fc47a0ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:46.868981 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6394fe-9090-4ab4-88fa-73a72718b593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:46.870053 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Volume 44d7e113-0b68-4b4b-bd08-160ac4fe0c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d7e113-0b68-4b4b-bd08-160ac4fe0c50', 'volume_size': 1} Jul 30 21:33:46.870440 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] creating volume 'volume-44d7e113-0b68-4b4b-bd08-160ac4fe0c50' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:33:46.871192 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:46.925914 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:33:46.926273 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:33:46.930131 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6394fe-9090-4ab4-88fa-73a72718b593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d7e113-0b68-4b4b-bd08-160ac4fe0c50', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:46.934836 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7d80a8-cb95-4002-a75c-bce9aaa4ed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:46.944821 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Volume volume-44d7e113-0b68-4b4b-bd08-160ac4fe0c50 (44d7e113-0b68-4b4b-bd08-160ac4fe0c50): created successfully Jul 30 21:33:46.948572 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7d80a8-cb95-4002-a75c-bce9aaa4ed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:46.953994 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Flow 'volume_create_manager' (c1aed6f3-a0e0-4868-b952-8ae22ec24c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:33:46.963161 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8dfe557b-4ba8-4ca7-b91a-b4a7d415fde2 tempest-AttachVolumeTestJSON-1877777549 None] Created volume successfully. Jul 30 21:33:48.401749 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-802d9658-caa2-4573-9e38-4605ba26ac94 req-1b2cef78-2304-4b33-ae06-cf309e90e4db tempest-AttachVolumeTestJSON-1877777549 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:33:49.166712 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-802d9658-caa2-4573-9e38-4605ba26ac94 req-1b2cef78-2304-4b33-ae06-cf309e90e4db tempest-AttachVolumeTestJSON-1877777549 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.765s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:33:49.167715 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-802d9658-caa2-4573-9e38-4605ba26ac94 req-1b2cef78-2304-4b33-ae06-cf309e90e4db tempest-AttachVolumeTestJSON-1877777549 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-44d7e113-0b68-4b4b-bd08-160ac4fe0c50', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '44d7e113-0b68-4b4b-bd08-160ac4fe0c50', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:33:49.195549 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-802d9658-caa2-4573-9e38-4605ba26ac94 req-1b2cef78-2304-4b33-ae06-cf309e90e4db tempest-AttachVolumeTestJSON-1877777549 None] Connection info returned from driver {'name': 'volumes/volume-44d7e113-0b68-4b4b-bd08-160ac4fe0c50', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '44d7e113-0b68-4b4b-bd08-160ac4fe0c50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ef4854c2-2235-4ae9-96fa-987f55fa7df5'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:33:49.250725 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-802d9658-caa2-4573-9e38-4605ba26ac94 req-1b2cef78-2304-4b33-ae06-cf309e90e4db tempest-AttachVolumeTestJSON-1877777549 None] attachment_update completed successfully. Jul 30 21:33:51.975781 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:33:51.996024 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Flow 'volume_create_manager' (0d01ba9b-094d-433a-87e8-46a1ea74dfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:33:52.003382 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6794d0e-83a7-4177-bc76-43694e98ae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:52.019785 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6794d0e-83a7-4177-bc76-43694e98ae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-39224730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=efda9a59-83d1-427b-8df8-e3439f11f71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7b4209e06447d5abdff867f9a7adce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:33:52Z,use_quota=True,user_id='5a6da0171fac41fb934ed2b294081531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:52.024976 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc042dc0-662a-4cae-ba25-17d06f3c327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:52.028971 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc042dc0-662a-4cae-ba25-17d06f3c327f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:52.034425 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2ad950-157c-43d2-a309-c1951db8eeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:52.038385 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2ad950-157c-43d2-a309-c1951db8eeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efda9a59-83d1-427b-8df8-e3439f11f71f', 'volume_name': 'volume-efda9a59-83d1-427b-8df8-e3439f11f71f', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:52.043173 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbc1f55-7f8e-4f48-87d9-82399bd7d516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:52.046996 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbc1f55-7f8e-4f48-87d9-82399bd7d516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:52.053186 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd43d8ca-db0f-462d-89ae-74a132695dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:52.054234 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Volume efda9a59-83d1-427b-8df8-e3439f11f71f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efda9a59-83d1-427b-8df8-e3439f11f71f', 'volume_size': 1} Jul 30 21:33:52.054638 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] creating volume 'volume-efda9a59-83d1-427b-8df8-e3439f11f71f' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:33:52.055406 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:52.109726 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:33:52.109726 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:33:52.110751 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd43d8ca-db0f-462d-89ae-74a132695dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efda9a59-83d1-427b-8df8-e3439f11f71f', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:52.115934 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7969d4b4-b2fc-457f-89b2-85b051e41f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:33:52.127098 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Volume volume-efda9a59-83d1-427b-8df8-e3439f11f71f (efda9a59-83d1-427b-8df8-e3439f11f71f): created successfully Jul 30 21:33:52.131051 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7969d4b4-b2fc-457f-89b2-85b051e41f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:33:52.136416 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Flow 'volume_create_manager' (0d01ba9b-094d-433a-87e8-46a1ea74dfd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:33:52.144858 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-db0c8c62-5a81-4821-a44b-38d7c55f5cde tempest-AttachVolumeTestJSON-1877777549 None] Created volume successfully. Jul 30 21:33:53.472262 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-8b167c08-e661-49cc-a7bc-6e075aea2301 req-2a9f0b49-486c-4076-85f6-b50f181d6343 tempest-AttachVolumeTestJSON-1877777549 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:33:54.236193 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-8b167c08-e661-49cc-a7bc-6e075aea2301 req-2a9f0b49-486c-4076-85f6-b50f181d6343 tempest-AttachVolumeTestJSON-1877777549 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.764s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:33:54.237019 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-8b167c08-e661-49cc-a7bc-6e075aea2301 req-2a9f0b49-486c-4076-85f6-b50f181d6343 tempest-AttachVolumeTestJSON-1877777549 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-efda9a59-83d1-427b-8df8-e3439f11f71f', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'efda9a59-83d1-427b-8df8-e3439f11f71f', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:33:54.261484 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-8b167c08-e661-49cc-a7bc-6e075aea2301 req-2a9f0b49-486c-4076-85f6-b50f181d6343 tempest-AttachVolumeTestJSON-1877777549 None] Connection info returned from driver {'name': 'volumes/volume-efda9a59-83d1-427b-8df8-e3439f11f71f', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'efda9a59-83d1-427b-8df8-e3439f11f71f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f8676acc-f34e-4e67-bb59-10a8efbaa405'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:33:54.323460 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-8b167c08-e661-49cc-a7bc-6e075aea2301 req-2a9f0b49-486c-4076-85f6-b50f181d6343 tempest-AttachVolumeTestJSON-1877777549 None] attachment_update completed successfully. Jul 30 21:33:56.602355 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-0d960867-9814-4bb0-b503-fa4071f9c018 req-4f9bd053-6781-435a-b7b8-7ad9f82fc105 tempest-AttachVolumeTestJSON-1877777549 None] Terminate volume connection completed successfully. Jul 30 21:33:56.602976 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-0d960867-9814-4bb0-b503-fa4071f9c018 req-4f9bd053-6781-435a-b7b8-7ad9f82fc105 tempest-AttachVolumeTestJSON-1877777549 None] Deleting attachment ef4854c2-2235-4ae9-96fa-987f55fa7df5. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:33:56.984645 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=23,cinder:DELETE=3,cinder:SELECT=49,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:33:57.029966 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-10761a0e-7afc-4d88-9589-cd05ce05d1f7 tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['d3091402-4f30-4b72-b0c6-e82b5ce9393f', '7cd2a280-0bc3-4ca4-99e8-2d68e147bc44', '6d190e82-f2b1-483e-bec0-950f818e539c', '432f72b0-ce7e-42c8-8a7f-2c463186590c'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:33:57.065865 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-10761a0e-7afc-4d88-9589-cd05ce05d1f7 tempest-VolumesSnapshotTestJSON-1137680000 None] Delete snapshot completed successfully. Jul 30 21:33:57.075472 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-10761a0e-7afc-4d88-9589-cd05ce05d1f7 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-1011da42-668f-49a3-848d-550c58d239af-delete_snapshot" released by "delete_snapshot" :: held 30.199s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:33:57.874327 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6b987f31-3de0-4d5f-8467-6d05c34fce87 tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-1b8cbab8-78ef-4c40-ba61-24162e8a7619-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:33:57.887058 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6b987f31-3de0-4d5f-8467-6d05c34fce87 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-1b8cbab8-78ef-4c40-ba61-24162e8a7619-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:33:57.889037 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6b987f31-3de0-4d5f-8467-6d05c34fce87 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:33:57.949550 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-11ade789-06a4-466b-91fd-b768f08f06e0 req-9924c2b9-9f01-4e10-b149-fd118fc1f75a tempest-AttachVolumeTestJSON-1877777549 None] Terminate volume connection completed successfully. Jul 30 21:33:57.950124 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-11ade789-06a4-466b-91fd-b768f08f06e0 req-9924c2b9-9f01-4e10-b149-fd118fc1f75a tempest-AttachVolumeTestJSON-1877777549 None] Deleting attachment f8676acc-f34e-4e67-bb59-10a8efbaa405. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:34:03.734138 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] Acquiring lock "cinder-efda9a59-83d1-427b-8df8-e3439f11f71f-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:34:03.759729 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] Lock "cinder-efda9a59-83d1-427b-8df8-e3439f11f71f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:34:03.821996 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:03.883260 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:34:03.883858 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] Volume volume-efda9a59-83d1-427b-8df8-e3439f11f71f is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:34:03.888387 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] deleting rbd volume volume-efda9a59-83d1-427b-8df8-e3439f11f71f {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:34:04.152588 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] Created reservations ['193c4f26-de26-456f-ace5-e90c66893e58', '7b5a38b8-2677-4c62-8b95-2e82dd643642', 'fe7ec05b-3aed-4126-89e3-59f2a0b17dc7', '5113c4ed-b981-4f11-870e-59ff686739a7'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:34:04.202883 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:04.231691 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:04.257287 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:34:04.261388 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] Deleted volume successfully. Jul 30 21:34:04.274710 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-17f44a23-cd8d-4493-9f9b-8659fd7fd0a7 tempest-AttachVolumeTestJSON-1877777549 None] Lock "cinder-efda9a59-83d1-427b-8df8-e3439f11f71f-delete_volume" released by "delete_volume" :: held 0.515s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:34:04.910957 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] Acquiring lock "cinder-44d7e113-0b68-4b4b-bd08-160ac4fe0c50-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:34:04.923680 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] Lock "cinder-44d7e113-0b68-4b4b-bd08-160ac4fe0c50-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:34:04.967481 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:05.004388 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:34:05.004899 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] Volume volume-44d7e113-0b68-4b4b-bd08-160ac4fe0c50 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:34:05.008768 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] deleting rbd volume volume-44d7e113-0b68-4b4b-bd08-160ac4fe0c50 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:34:05.197606 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] Created reservations ['b945c998-1c34-4d29-be73-d8f9c632bc77', 'fa7b64c3-d2c6-4ae2-9ab2-5eec2c16de87', '6fa0bc4c-83d1-4b22-bd94-5e682e547e83', '946c3000-298b-4921-bb3c-7e9a371ea2c8'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:34:05.211528 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=70,cinder:DELETE=2,cinder:UPDATE=24,cinder:INSERT=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:05.246878 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:05.271994 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:05.297153 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:34:05.302117 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] Deleted volume successfully. Jul 30 21:34:05.314727 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3b6c04eb-452e-4040-8ed3-7ec165ec2e35 tempest-AttachVolumeTestJSON-1877777549 None] Lock "cinder-44d7e113-0b68-4b4b-bd08-160ac4fe0c50-delete_volume" released by "delete_volume" :: held 0.392s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:34:06.139842 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] Acquiring lock "cinder-600fb7d5-259f-4c12-a1f9-57e6e59664cd-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:34:06.151331 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] Lock "cinder-600fb7d5-259f-4c12-a1f9-57e6e59664cd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:34:06.190972 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:06.247497 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:34:06.248129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] Volume volume-600fb7d5-259f-4c12-a1f9-57e6e59664cd is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:34:06.254045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] deleting rbd volume volume-600fb7d5-259f-4c12-a1f9-57e6e59664cd {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:34:06.433354 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] Created reservations ['acfea1b0-9002-4871-8a5e-98d862d7e61d', 'a4459303-8ab8-4d33-9c3a-df9e13aa8723', 'd7c97b24-2bf1-4aea-a592-0fa7e11e11f8', '580175ff-5b51-4cd3-bdfb-8e24b3653eca'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:34:06.508866 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:06.555759 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:06.583409 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:34:06.588560 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] Deleted volume successfully. Jul 30 21:34:06.604825 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3372b97c-d3dd-4758-aa68-c6060cd58c00 tempest-AttachVolumeTestJSON-1877777549 None] Lock "cinder-600fb7d5-259f-4c12-a1f9-57e6e59664cd-delete_volume" released by "delete_volume" :: held 0.454s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:34:16.076818 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:34:16.077423 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:16.151068 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:16.222201 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:34:24.324136 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=13,cinder:SELECT=11,cinder:DELETE=1,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:27.984853 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=58,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:28.053038 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-6b987f31-3de0-4d5f-8467-6d05c34fce87 tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['9e6188fa-9bfc-4162-b1a6-c310ebdaf0dc', 'c6e9e2b1-bf57-4ce5-91ae-944df7a3cd1a', '8c9055aa-925b-4960-ba62-abc19cdf69c2', '7fdffd75-e5be-4cd8-adcf-2b824288e9ac'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:34:28.098616 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-6b987f31-3de0-4d5f-8467-6d05c34fce87 tempest-VolumesSnapshotTestJSON-1137680000 None] Delete snapshot completed successfully. Jul 30 21:34:28.104622 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-6b987f31-3de0-4d5f-8467-6d05c34fce87 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-1b8cbab8-78ef-4c40-ba61-24162e8a7619-delete_snapshot" released by "delete_snapshot" :: held 30.218s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:34:29.139312 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-53eb3d53-0539-41bd-8262-285f903408b7 tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-4c38a5d4-b6b2-4081-8851-3fc4962b66d2-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:34:29.154311 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-53eb3d53-0539-41bd-8262-285f903408b7 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-4c38a5d4-b6b2-4081-8851-3fc4962b66d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:34:29.157542 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-53eb3d53-0539-41bd-8262-285f903408b7 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:34:44.319647 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:59.270867 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:34:59.312832 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-53eb3d53-0539-41bd-8262-285f903408b7 tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['1bbe899f-2874-4d78-ac16-7904ed1ebbcd', 'b50bd0c3-3d49-4819-be8c-31dce5f60d0c', 'f1b3f0a4-ebfc-4226-bb1c-a04d0f0d5607', '68221998-5be0-42b2-ada0-40cb88929240'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:34:59.352104 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-53eb3d53-0539-41bd-8262-285f903408b7 tempest-VolumesSnapshotTestJSON-1137680000 None] Delete snapshot completed successfully. Jul 30 21:34:59.357628 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-53eb3d53-0539-41bd-8262-285f903408b7 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-4c38a5d4-b6b2-4081-8851-3fc4962b66d2-delete_snapshot" released by "delete_snapshot" :: held 30.203s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:35:00.954598 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-80cbc919-273f-466e-83b2-fcf13fc2d1c8 req-93b2e5af-d14f-4555-9991-38e11df750f6 tempest-VolumesSnapshotTestJSON-1137680000 None] Terminate volume connection completed successfully. Jul 30 21:35:00.955465 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-80cbc919-273f-466e-83b2-fcf13fc2d1c8 req-93b2e5af-d14f-4555-9991-38e11df750f6 tempest-VolumesSnapshotTestJSON-1137680000 None] Deleting attachment 79ae3de0-b64d-424a-a84c-78e065e87054. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:35:05.664072 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:35:05.698642 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (ad094ed8-4951-4ba5-b245-09aea55378f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:35:05.715458 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bc84d5-dc02-4469-89b7-3cc62f2a5aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:05.739055 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bc84d5-dc02-4469-89b7-3cc62f2a5aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1380834774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=39f31401-b495-4c0f-b001-bcd37aa180db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86550d66e9144788967e5b514cda82d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:35:06Z,use_quota=True,user_id='937935818cda4a6e8b9104d38aa3a8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:05.744863 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574870c0-c818-4db1-9b69-7f4cb894863a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:05.750635 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574870c0-c818-4db1-9b69-7f4cb894863a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:05.756642 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b93669-4c8f-46a2-89d7-dd41d57bbdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:05.761535 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b93669-4c8f-46a2-89d7-dd41d57bbdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f31401-b495-4c0f-b001-bcd37aa180db', 'volume_name': 'volume-39f31401-b495-4c0f-b001-bcd37aa180db', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:05.767810 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56759d22-bd8f-4b7e-adb1-3dbd28d1f0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:05.772495 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56759d22-bd8f-4b7e-adb1-3dbd28d1f0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:05.777752 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d69cba-0bee-42ba-902c-40f719b63ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:05.778969 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume 39f31401-b495-4c0f-b001-bcd37aa180db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f31401-b495-4c0f-b001-bcd37aa180db', 'volume_size': 1} Jul 30 21:35:05.779575 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] creating volume 'volume-39f31401-b495-4c0f-b001-bcd37aa180db' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:35:05.781193 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:05.840334 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:35:05.841021 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:35:05.847003 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d69cba-0bee-42ba-902c-40f719b63ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f31401-b495-4c0f-b001-bcd37aa180db', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:05.852198 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c414b7d-256b-4d89-9d08-fcdad5bbfa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:05.864139 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume volume-39f31401-b495-4c0f-b001-bcd37aa180db (39f31401-b495-4c0f-b001-bcd37aa180db): created successfully Jul 30 21:35:05.868119 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c414b7d-256b-4d89-9d08-fcdad5bbfa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:05.875400 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (ad094ed8-4951-4ba5-b245-09aea55378f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:35:05.885920 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-102e9dd2-dccf-48a9-958a-de9c05a01713 tempest-VolumesSnapshotTestJSON-1137680000 None] Created volume successfully. Jul 30 21:35:06.833334 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2f1623fc-e499-4d12-abde-00dcd0f283a3 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:06.975119 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2f1623fc-e499-4d12-abde-00dcd0f283a3 tempest-VolumesSnapshotTestJSON-1137680000 None] Create snapshot completed successfully Jul 30 21:35:08.251854 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:35:08.279323 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (36c695ac-1ed0-4b0d-b780-4cc205b6f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:35:08.285578 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f7afa8-7dd2-4a67-bc06-5fe5ea12da1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:08.308202 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f7afa8-7dd2-4a67-bc06-5fe5ea12da1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-237330423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6682b3fd-0900-4ebd-8a17-978d1ea6900e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86550d66e9144788967e5b514cda82d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:35:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a4578cd0-c4fe-4a25-a7c6-bfce1780e5b6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:35:08Z,use_quota=True,user_id='937935818cda4a6e8b9104d38aa3a8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:08.316453 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66304611-ee6c-4e6a-be48-ec24046907f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:08.320615 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66304611-ee6c-4e6a-be48-ec24046907f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:08.325563 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61f6712-db39-45cc-80a8-c84e8b1308d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:08.329553 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61f6712-db39-45cc-80a8-c84e8b1308d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6682b3fd-0900-4ebd-8a17-978d1ea6900e', 'volume_name': 'volume-6682b3fd-0900-4ebd-8a17-978d1ea6900e', 'volume_size': 2, 'snapshot_id': 'a4578cd0-c4fe-4a25-a7c6-bfce1780e5b6'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:08.334799 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50dbfe7-5eb8-4db1-9896-aa32303b91f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:08.338658 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50dbfe7-5eb8-4db1-9896-aa32303b91f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:08.343975 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c47591-ac3d-49a0-9715-c90c91353c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:08.345158 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume 6682b3fd-0900-4ebd-8a17-978d1ea6900e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6682b3fd-0900-4ebd-8a17-978d1ea6900e', 'volume_size': 2, 'snapshot_id': 'a4578cd0-c4fe-4a25-a7c6-bfce1780e5b6'} Jul 30 21:35:08.364856 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] cloning volumes/volume-39f31401-b495-4c0f-b001-bcd37aa180db@snapshot-a4578cd0-c4fe-4a25-a7c6-bfce1780e5b6 to volume-6682b3fd-0900-4ebd-8a17-978d1ea6900e {{(pid=124008) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jul 30 21:35:08.365503 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:08.401052 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:08.512493 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:35:08.512937 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:35:08.517198 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:08.620455 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c47591-ac3d-49a0-9715-c90c91353c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6682b3fd-0900-4ebd-8a17-978d1ea6900e', 'volume_size': 2, 'snapshot_id': 'a4578cd0-c4fe-4a25-a7c6-bfce1780e5b6'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:08.625353 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e6eeed-6811-4912-8ec6-1a21fd489fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:08.637988 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume volume-6682b3fd-0900-4ebd-8a17-978d1ea6900e (6682b3fd-0900-4ebd-8a17-978d1ea6900e): created successfully Jul 30 21:35:08.641745 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e6eeed-6811-4912-8ec6-1a21fd489fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:08.647251 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (36c695ac-1ed0-4b0d-b780-4cc205b6f71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:35:08.660785 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-19b08739-7069-4e53-bcc5-78b1288c9a30 tempest-VolumesSnapshotTestJSON-1137680000 None] Created volume successfully. Jul 30 21:35:09.378905 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-6682b3fd-0900-4ebd-8a17-978d1ea6900e-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:35:09.390076 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-6682b3fd-0900-4ebd-8a17-978d1ea6900e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:35:09.427109 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:09.508265 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:35:09.514522 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] deleting rbd volume volume-6682b3fd-0900-4ebd-8a17-978d1ea6900e {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:35:09.744246 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['14c82a6b-8d3e-4569-bfc5-e642302a9d8d', 'f330201c-b598-4858-b4fd-b1fe237c7bff', '6f3dfa50-b608-4fce-8f37-4a15455eb2a7', '1e778113-5803-4988-b2af-8eabea18d40c'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:09.795667 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:09.831305 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:09.867495 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:35:09.871769 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] Deleted volume successfully. Jul 30 21:35:09.887080 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8fa50611-3663-4da3-a079-7a3e05f634f6 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-6682b3fd-0900-4ebd-8a17-978d1ea6900e-delete_volume" released by "delete_volume" :: held 0.497s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:35:10.900394 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:35:10.925459 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (6be5446b-578c-45d5-a675-786950c918c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:35:10.933616 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5874003b-ab19-45b0-b554-62dd4f236948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:10.955057 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5874003b-ab19-45b0-b554-62dd4f236948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-720514935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86550d66e9144788967e5b514cda82d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:35:11Z,use_quota=True,user_id='937935818cda4a6e8b9104d38aa3a8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:10.960824 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167f5475-b415-4d37-890b-a314365211f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:10.965191 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167f5475-b415-4d37-890b-a314365211f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:10.970607 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7a60d5-8f75-4848-8bd5-01a801c049a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:10.975089 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7a60d5-8f75-4848-8bd5-01a801c049a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5', 'volume_name': 'volume-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:10.980237 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4be9b3-b7f8-4b0f-ae6e-bf3c04f00953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:10.984402 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4be9b3-b7f8-4b0f-ae6e-bf3c04f00953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:10.989319 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf42354-815a-4bd5-b369-29e074568506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:10.990578 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Volume 4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5', 'volume_size': 1} Jul 30 21:35:10.991084 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] creating volume 'volume-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:35:10.992004 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:11.065580 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:35:11.065980 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:35:11.069670 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf42354-815a-4bd5-b369-29e074568506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:11.075644 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bf6552-4d5e-4936-827a-287cd1e2e50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:11.087688 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Volume volume-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5 (4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5): created successfully Jul 30 21:35:11.092084 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bf6552-4d5e-4936-827a-287cd1e2e50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:11.097976 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (6be5446b-578c-45d5-a675-786950c918c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:35:11.109509 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-6391b9c9-926e-48d6-9230-a926d8da578e tempest-VolumesSnapshotTestJSON-1137680000 None] Created volume successfully. Jul 30 21:35:12.293530 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-41b41eec-8524-46e6-aa25-f9319e1dbba2 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:13.063538 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-41b41eec-8524-46e6-aa25-f9319e1dbba2 tempest-VolumesSnapshotTestJSON-1137680000 None] Create snapshot completed successfully Jul 30 21:35:13.751129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:35:13.801061 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (33ad3b9b-6217-4ba8-b077-d8b1cba3a6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:35:13.809737 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bea0da8-6dd4-425b-b3dc-983155a1bf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:13.834525 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bea0da8-6dd4-425b-b3dc-983155a1bf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-555655148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ef437de-4b1c-4347-aae1-679d7076afd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86550d66e9144788967e5b514cda82d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9045a60e-b4a5-4231-9ff1-9a521ba823de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:35:14Z,use_quota=True,user_id='937935818cda4a6e8b9104d38aa3a8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:13.840002 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ae73d4-9157-4410-be09-11d7357e6a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:13.844490 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ae73d4-9157-4410-be09-11d7357e6a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:13.850669 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc37ece-58cc-4461-9455-1ce2dac250c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:13.854605 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc37ece-58cc-4461-9455-1ce2dac250c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ef437de-4b1c-4347-aae1-679d7076afd0', 'volume_name': 'volume-8ef437de-4b1c-4347-aae1-679d7076afd0', 'volume_size': 1, 'snapshot_id': '9045a60e-b4a5-4231-9ff1-9a521ba823de'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:13.859425 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54739147-c806-4a90-9e8b-cb81730a2707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:13.863185 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54739147-c806-4a90-9e8b-cb81730a2707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:13.867800 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7492ff-7459-4563-afce-e981fc93077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:13.868851 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Volume 8ef437de-4b1c-4347-aae1-679d7076afd0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ef437de-4b1c-4347-aae1-679d7076afd0', 'volume_size': 1, 'snapshot_id': '9045a60e-b4a5-4231-9ff1-9a521ba823de'} Jul 30 21:35:13.891083 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] cloning volumes/volume-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5@snapshot-9045a60e-b4a5-4231-9ff1-9a521ba823de to volume-8ef437de-4b1c-4347-aae1-679d7076afd0 {{(pid=124008) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jul 30 21:35:13.891759 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:13.929357 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:14.056182 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:35:14.056843 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:35:14.082833 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7492ff-7459-4563-afce-e981fc93077b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef437de-4b1c-4347-aae1-679d7076afd0', 'volume_size': 1, 'snapshot_id': '9045a60e-b4a5-4231-9ff1-9a521ba823de'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:14.097672 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6292c3-146d-4d63-9459-366895647e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:14.109955 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Volume volume-8ef437de-4b1c-4347-aae1-679d7076afd0 (8ef437de-4b1c-4347-aae1-679d7076afd0): created successfully Jul 30 21:35:14.114943 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6292c3-146d-4d63-9459-366895647e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:14.121225 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Flow 'volume_create_manager' (33ad3b9b-6217-4ba8-b077-d8b1cba3a6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:35:14.144810 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-984ad738-137a-49aa-ba2d-05e25c84ce6b tempest-VolumesSnapshotTestJSON-1137680000 None] Created volume successfully. Jul 30 21:35:14.889973 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-8ef437de-4b1c-4347-aae1-679d7076afd0-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:35:14.902759 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-8ef437de-4b1c-4347-aae1-679d7076afd0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:35:14.913567 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=61,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:14.942760 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:15.019645 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:35:15.025541 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] deleting rbd volume volume-8ef437de-4b1c-4347-aae1-679d7076afd0 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:35:15.236140 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=66,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:15.241306 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['ed71cf78-82e5-4141-b879-75982bee0042', 'cbf09fe1-d45e-4af4-b3b2-0ab9b14b13fb', 'b45eab6d-da4d-4f7a-a653-fe760f038b6e', '48c8347a-1cc3-49fe-9339-f9b435047206'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:15.294153 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:15.326993 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:15.357874 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:35:15.361824 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] Deleted volume successfully. Jul 30 21:35:15.374474 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-61493380-98b4-4c64-8d1a-57547f49e332 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-8ef437de-4b1c-4347-aae1-679d7076afd0-delete_volume" released by "delete_volume" :: held 0.472s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:35:16.081542 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:35:16.082211 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:16.122560 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:16.147453 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:35:16.151208 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8d6931cc-0f35-487b-acfa-763acebcdd88 tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-9045a60e-b4a5-4231-9ff1-9a521ba823de-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:35:16.162699 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8d6931cc-0f35-487b-acfa-763acebcdd88 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-9045a60e-b4a5-4231-9ff1-9a521ba823de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:35:16.164589 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8d6931cc-0f35-487b-acfa-763acebcdd88 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:17.079003 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8d6931cc-0f35-487b-acfa-763acebcdd88 tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['864186f6-6ba8-43ad-8c22-a2833ac878a7', '1cdab48b-75ae-40d8-9228-4a4ea00b23e0', 'c20bf456-71ae-48fc-a654-57982cab2c93', 'e3a1f887-3ba8-4026-bd5b-9c8c86427578'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:17.133582 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8d6931cc-0f35-487b-acfa-763acebcdd88 tempest-VolumesSnapshotTestJSON-1137680000 None] Delete snapshot completed successfully. Jul 30 21:35:17.138915 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-8d6931cc-0f35-487b-acfa-763acebcdd88 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-9045a60e-b4a5-4231-9ff1-9a521ba823de-delete_snapshot" released by "delete_snapshot" :: held 0.976s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:35:17.203823 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:35:17.216467 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:35:17.255968 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:17.307449 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:35:17.308010 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume volume-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:35:17.314545 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] deleting rbd volume volume-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:35:17.513312 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['da29b10e-cde2-4111-b946-5d012b7237a5', '1a60ab32-db1f-462d-b09f-9d99dfd7a434', 'abf1e85c-40f7-49fd-abac-639c7be04e1d', '59063eb9-abb3-499f-ab79-98ebf7f7536b'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:17.558171 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:17.587680 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:17.615225 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:35:17.619369 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] Deleted volume successfully. Jul 30 21:35:17.634082 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-68b3707e-4934-4a0d-8a87-ca213f1e7cc0 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-4af4d4b2-6a15-4c5f-b68d-794ce5d9eab5-delete_volume" released by "delete_volume" :: held 0.418s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:35:18.380867 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-47e17bf8-2371-47ca-9cc9-0cfa0e4d64da tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-a4578cd0-c4fe-4a25-a7c6-bfce1780e5b6-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:35:18.394976 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-47e17bf8-2371-47ca-9cc9-0cfa0e4d64da tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-a4578cd0-c4fe-4a25-a7c6-bfce1780e5b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:35:18.405917 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-47e17bf8-2371-47ca-9cc9-0cfa0e4d64da tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:19.148591 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-47e17bf8-2371-47ca-9cc9-0cfa0e4d64da tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['3268ee4e-7356-40cf-af30-dcc0e3ed4cae', 'af5b6439-e5db-42d7-8a46-8021f38a8a88', 'aefd2f9c-b8c1-47be-bdca-19858cc0fb00', '9769dd6e-dd14-4242-b99b-86397e414fed'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:19.205158 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-47e17bf8-2371-47ca-9cc9-0cfa0e4d64da tempest-VolumesSnapshotTestJSON-1137680000 None] Delete snapshot completed successfully. Jul 30 21:35:19.214501 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-47e17bf8-2371-47ca-9cc9-0cfa0e4d64da tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-a4578cd0-c4fe-4a25-a7c6-bfce1780e5b6-delete_snapshot" released by "delete_snapshot" :: held 0.819s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:35:19.498778 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-39f31401-b495-4c0f-b001-bcd37aa180db-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:35:19.510913 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-39f31401-b495-4c0f-b001-bcd37aa180db-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:35:19.562223 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:19.651396 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:35:19.652285 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] Volume volume-39f31401-b495-4c0f-b001-bcd37aa180db is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:35:19.661952 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] deleting rbd volume volume-39f31401-b495-4c0f-b001-bcd37aa180db {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:35:20.028522 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['74d1224e-f803-4f78-b60f-59ddf1478243', 'a11fdc19-fc2e-47e8-9f99-f832a2b188de', 'cde526e3-79c3-4f58-b3b0-08a7ba4c94ff', 'a42c4e97-d739-4613-a247-83a6c37ba5d5'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:20.088124 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:20.132965 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:20.182881 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:35:20.189097 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] Deleted volume successfully. Jul 30 21:35:20.206499 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-98408c2a-d244-4594-bb09-184faef0cdac tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-39f31401-b495-4c0f-b001-bcd37aa180db-delete_volume" released by "delete_volume" :: held 0.697s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:35:20.876813 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-3a0555a8-f248-41c2-b23f-fd458dbd282b-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:35:20.897434 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-3a0555a8-f248-41c2-b23f-fd458dbd282b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:35:20.900620 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=48,cinder:INSERT=16,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:20.948580 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:21.036536 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:35:21.051835 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] deleting rbd volume volume-3a0555a8-f248-41c2-b23f-fd458dbd282b {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:35:21.215375 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:35:21.243447 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] deleting parent snapshot volume-3a0555a8-f248-41c2-b23f-fd458dbd282b.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:35:22.144659 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['dfde1d91-b1da-4eb4-8b48-777ce437efbc', 'b50712a7-42f8-44dd-9a25-0b8e31451c6c', '452cdf55-f698-45ca-85c0-11068fbe31e2', '597d2b5d-146c-4159-9db8-3253c0210b80'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:22.148872 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=37,cinder:SELECT=60,cinder:DELETE=1,cinder:INSERT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:22.204382 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:22.239090 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:22.277135 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:35:22.282643 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] Deleted volume successfully. Jul 30 21:35:22.297550 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-77be8014-41a7-4350-bc5e-8fd5bc609a1f tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-3a0555a8-f248-41c2-b23f-fd458dbd282b-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:35:23.157528 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-dffe37af-03c8-4944-9a76-b67fbccc5ffe tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-759f2a4c-2e6d-422f-b244-6260c4440cef-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:35:23.172241 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-dffe37af-03c8-4944-9a76-b67fbccc5ffe tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-759f2a4c-2e6d-422f-b244-6260c4440cef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:35:23.174912 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-dffe37af-03c8-4944-9a76-b67fbccc5ffe tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:24.228198 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-dffe37af-03c8-4944-9a76-b67fbccc5ffe tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['c863a490-0a89-43fe-87a7-dc4ed8074dfc', '946d2f01-b490-4ea5-b4c9-cdca8b75c2dc', '94430a8d-4272-4a27-a8ca-a7f41a35ad4c', 'db4afeec-75e0-4484-8b38-744fa4b1b088'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:24.291523 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-dffe37af-03c8-4944-9a76-b67fbccc5ffe tempest-VolumesSnapshotTestJSON-1137680000 None] Delete snapshot completed successfully. Jul 30 21:35:24.298670 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-dffe37af-03c8-4944-9a76-b67fbccc5ffe tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-759f2a4c-2e6d-422f-b244-6260c4440cef-delete_snapshot" released by "delete_snapshot" :: held 1.127s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:35:25.358878 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] Acquiring lock "cinder-629d4006-7b40-4644-8678-fd6e4b6063f7-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:35:25.369666 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-629d4006-7b40-4644-8678-fd6e4b6063f7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:35:25.413246 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:25.458067 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:35:25.459118 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] Volume volume-629d4006-7b40-4644-8678-fd6e4b6063f7 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:35:25.463524 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] deleting rbd volume volume-629d4006-7b40-4644-8678-fd6e4b6063f7 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:35:25.734557 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] Created reservations ['41de4f9e-2c8e-4d66-9f06-4b66b3dd8b72', '105311f2-1df9-40c1-b7a3-c290072fadfa', '7c956282-27d5-4974-a875-7444cbf96a43', 'e0ae91db-aebb-4985-a8a4-24ab58a03be9'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:25.796076 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:25.835632 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:25.890903 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:35:25.900642 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] Deleted volume successfully. Jul 30 21:35:25.923789 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-199ef00c-e10f-4d9f-a71d-684c7cbee029 tempest-VolumesSnapshotTestJSON-1137680000 None] Lock "cinder-629d4006-7b40-4644-8678-fd6e4b6063f7-delete_volume" released by "delete_volume" :: held 0.554s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:35:48.816386 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-a307c70d-b645-4621-b47e-7d1ea6f28839 tempest-BackendsCapabilitiesAdminTestsJSON-1753401816 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:48ff4353-db26-438b-9f54-5e325bcdd5eb:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=124008) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}} Jul 30 21:35:48.857285 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-2d6bd0f6-4d9b-4941-84fa-78cddb632491 tempest-BackendsCapabilitiesAdminTestsJSON-1753401816 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:48ff4353-db26-438b-9f54-5e325bcdd5eb:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=124008) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}} Jul 30 21:35:52.213238 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=28,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:52.222227 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=36,cinder:INSERT=6,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:35:52.224589 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-cc7e177a-0521-4dfd-b7f6-0207d41f3d32 tempest-GroupSnapshotsTest-1746024774 None] Group tempest-GroupSnapshotsTest-Group-1397896541: creating Jul 30 21:35:52.248882 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-cc7e177a-0521-4dfd-b7f6-0207d41f3d32 tempest-GroupSnapshotsTest-1746024774 None] Group tempest-GroupSnapshotsTest-Group-1397896541: created successfully Jul 30 21:35:52.261713 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-cc7e177a-0521-4dfd-b7f6-0207d41f3d32 tempest-GroupSnapshotsTest-1746024774 None] Create group completed successfully. Jul 30 21:35:53.634431 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:35:53.653493 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Flow 'volume_create_manager' (a683a326-8ec9-4df6-8d30-83d161131f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:35:53.659687 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d41535-9787-4035-b808-a81176a331b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:53.675037 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d41535-9787-4035-b808-a81176a331b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1821101271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe01bcba-06bf-4405-b9cf-b2583b56e361,host='ncdv-master-1@ceph#ceph',id=3122abf1-5f42-43bb-b47b-8015887e5329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a61164d3b4464c8efba365fa6c2441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:35:54Z,use_quota=True,user_id='d83bbcb9fcd044ffbd701ae31834229c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d1b4ca7-36de-41ed-93bd-825446f986b2),volume_type_id=9d1b4ca7-36de-41ed-93bd-825446f986b2)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:53.680179 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eb5804-ec9b-4522-b3ce-f7b3197fc09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:53.684778 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eb5804-ec9b-4522-b3ce-f7b3197fc09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:53.689664 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f7b24e-db1b-4527-9cd1-433de9d1a528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:53.693554 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f7b24e-db1b-4527-9cd1-433de9d1a528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3122abf1-5f42-43bb-b47b-8015887e5329', 'volume_name': 'volume-3122abf1-5f42-43bb-b47b-8015887e5329', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:53.698260 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4a0789-23aa-46f4-99b9-c2ef236c2e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:53.702637 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4a0789-23aa-46f4-99b9-c2ef236c2e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:53.707125 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03da2a8-153a-4961-850d-7d07004b3691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:53.708247 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Volume 3122abf1-5f42-43bb-b47b-8015887e5329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3122abf1-5f42-43bb-b47b-8015887e5329', 'volume_size': 1} Jul 30 21:35:53.708634 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] creating volume 'volume-3122abf1-5f42-43bb-b47b-8015887e5329' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:35:53.709392 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:53.767447 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:35:53.767824 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:35:53.771687 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03da2a8-153a-4961-850d-7d07004b3691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3122abf1-5f42-43bb-b47b-8015887e5329', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:53.776225 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ccf180-9a4b-4ed2-b209-1d112afd2ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:35:53.785640 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Volume volume-3122abf1-5f42-43bb-b47b-8015887e5329 (3122abf1-5f42-43bb-b47b-8015887e5329): created successfully Jul 30 21:35:53.789187 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ccf180-9a4b-4ed2-b209-1d112afd2ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:35:53.794697 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Flow 'volume_create_manager' (a683a326-8ec9-4df6-8d30-83d161131f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:35:53.804211 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b4d3bd2b-bb36-4bcb-840e-133357b47d43 tempest-GroupSnapshotsTest-1746024774 None] Created volume successfully. Jul 30 21:35:54.904813 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-584f89f4-574c-46b1-86ea-1bfd145d4ffe tempest-GroupSnapshotsTest-1746024774 None] GroupSnapshot 552ecf9a-4219-4d63-b54b-56aeaf1e6bb5: creating. Jul 30 21:35:54.926474 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-584f89f4-574c-46b1-86ea-1bfd145d4ffe tempest-GroupSnapshotsTest-1746024774 None] Group snapshot 552ecf9a-4219-4d63-b54b-56aeaf1e6bb5: creating. {{(pid=124008) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}} Jul 30 21:35:54.946203 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-584f89f4-574c-46b1-86ea-1bfd145d4ffe tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:55.555022 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-584f89f4-574c-46b1-86ea-1bfd145d4ffe tempest-GroupSnapshotsTest-1746024774 None] group_snapshot 552ecf9a-4219-4d63-b54b-56aeaf1e6bb5: created successfully Jul 30 21:35:56.482730 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74bca496-b249-49e3-8f6a-0fb0e39d5ec2 tempest-GroupSnapshotsTest-1746024774 None] cloning volumes/volume-3122abf1-5f42-43bb-b47b-8015887e5329@snapshot-e534c43c-72dd-4b35-8db0-552b4ffb78ff to volume-e06f4e6e-2404-4bd3-8f51-e6ccdc2293cf {{(pid=124008) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jul 30 21:35:56.484126 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74bca496-b249-49e3-8f6a-0fb0e39d5ec2 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:56.530035 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74bca496-b249-49e3-8f6a-0fb0e39d5ec2 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:56.650965 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74bca496-b249-49e3-8f6a-0fb0e39d5ec2 tempest-GroupSnapshotsTest-1746024774 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:35:56.651447 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74bca496-b249-49e3-8f6a-0fb0e39d5ec2 tempest-GroupSnapshotsTest-1746024774 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:35:56.717693 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-74bca496-b249-49e3-8f6a-0fb0e39d5ec2 tempest-GroupSnapshotsTest-1746024774 None] Create group from source-snapshot-552ecf9a-4219-4d63-b54b-56aeaf1e6bb5 completed successfully. Jul 30 21:35:58.031001 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:58.090440 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:35:58.096014 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] deleting rbd volume volume-e06f4e6e-2404-4bd3-8f51-e6ccdc2293cf {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:35:58.309129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['0e6fd9b9-3adc-4570-b754-4f1db001ae82'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:58.330140 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-260060080 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-260060080, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:35:58.331084 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-260060080 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-260060080, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:35:58.348612 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['0be077cf-4f20-4452-81d5-cea26558d763', '653268f2-df28-46f7-9c08-80a47dd82941', 'e6282b5d-0074-4339-a2eb-1f1bf075b577', '465fc63f-3bb1-40b5-a5f9-7336d472f567'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:58.445493 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:58.494947 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:58.525421 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:35:58.529667 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-db2fc31a-9a47-4423-abda-5d4084cbb598 tempest-GroupSnapshotsTest-1746024774 None] Delete group completed successfully. Jul 30 21:35:59.193545 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8a95e759-4c42-44cd-bdc2-07e49fd5d994 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot 552ecf9a-4219-4d63-b54b-56aeaf1e6bb5: deleting Jul 30 21:35:59.210510 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-8a95e759-4c42-44cd-bdc2-07e49fd5d994 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot 552ecf9a-4219-4d63-b54b-56aeaf1e6bb5: deleting {{(pid=124008) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}} Jul 30 21:35:59.230632 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-8a95e759-4c42-44cd-bdc2-07e49fd5d994 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:35:59.578609 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-8a95e759-4c42-44cd-bdc2-07e49fd5d994 tempest-GroupSnapshotsTest-1746024774 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-260060080 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-260060080, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:35:59.593720 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-8a95e759-4c42-44cd-bdc2-07e49fd5d994 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['5fcb1012-c21b-4a0c-b74b-256527814922', '25816089-6399-4f87-b1f0-1ee55146d753', 'b6fbba73-07d6-46fb-b9cd-0567dcd9c516', 'fe358a7e-a053-4fb1-8c48-0ada25232895'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:35:59.641640 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8a95e759-4c42-44cd-bdc2-07e49fd5d994 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot 552ecf9a-4219-4d63-b54b-56aeaf1e6bb5: deleted successfully Jul 30 21:36:00.589567 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=68,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=6 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:00.618602 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:00.660025 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:36:00.660534 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] Volume volume-3122abf1-5f42-43bb-b47b-8015887e5329 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:36:00.665282 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] deleting rbd volume volume-3122abf1-5f42-43bb-b47b-8015887e5329 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:36:00.823061 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['719cd855-137c-40a9-91ff-b577bf37d96d'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:00.837630 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=73,cinder:UPDATE=23,cinder:INSERT=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:00.853463 ncdv-master-1 cinder-volume[124008]: WARNING cinder.db.sqlalchemy.api [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-260060080'] Jul 30 21:36:00.856134 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['3e761a42-2598-4b46-8b32-f85204e85ae3', '279040ca-effb-41b3-ab3e-5daf7b74b1d1', '6db23548-6a03-4754-89a7-40f1ce457d61', '2f681182-1f69-498c-83fd-40c2f095692c'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:00.929829 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:00.954929 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:00.979204 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:36:00.983347 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-74b68bc9-aa91-4d05-9562-20f1c0d5d8f9 tempest-GroupSnapshotsTest-1746024774 None] Delete group completed successfully. Jul 30 21:36:01.945954 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8353d8e2-e338-447e-88cd-5193fe1306a9 tempest-GroupSnapshotsTest-1746024774 None] Group tempest-GroupSnapshotsTest-Group-982102744: creating Jul 30 21:36:01.963014 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8353d8e2-e338-447e-88cd-5193fe1306a9 tempest-GroupSnapshotsTest-1746024774 None] Group tempest-GroupSnapshotsTest-Group-982102744: created successfully Jul 30 21:36:01.972263 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-8353d8e2-e338-447e-88cd-5193fe1306a9 tempest-GroupSnapshotsTest-1746024774 None] Create group completed successfully. Jul 30 21:36:03.321999 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:36:03.341232 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Flow 'volume_create_manager' (9ab8fff9-8495-4151-adcc-5ffa4c85df57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:36:03.347410 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fa2bdb-417c-4a20-a8d7-21ee22f5a6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:03.363712 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fa2bdb-417c-4a20-a8d7-21ee22f5a6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-55471190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30ba9b69-9aef-46c6-a81d-c0f281eecaea,host='ncdv-master-1@ceph#ceph',id=1cb82d7b-a650-420d-8119-e1212e99919a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a61164d3b4464c8efba365fa6c2441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:36:03Z,use_quota=True,user_id='d83bbcb9fcd044ffbd701ae31834229c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3bc0de0b-17d1-4df5-8d10-5225d4f11e28),volume_type_id=3bc0de0b-17d1-4df5-8d10-5225d4f11e28)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:03.368868 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b39567-cea0-4915-8a3a-14fb2043c6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:03.372847 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b39567-cea0-4915-8a3a-14fb2043c6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:03.378001 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1598050-ceb9-4fda-aeb3-3c164a65243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:03.381999 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1598050-ceb9-4fda-aeb3-3c164a65243d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cb82d7b-a650-420d-8119-e1212e99919a', 'volume_name': 'volume-1cb82d7b-a650-420d-8119-e1212e99919a', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:03.386893 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ad7c2c-2d3e-4145-a341-b6c6c14eb98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:03.390699 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ad7c2c-2d3e-4145-a341-b6c6c14eb98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:03.395238 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5e2dd1-9424-4a92-ac44-6760402e1bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:03.396381 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Volume 1cb82d7b-a650-420d-8119-e1212e99919a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cb82d7b-a650-420d-8119-e1212e99919a', 'volume_size': 1} Jul 30 21:36:03.396752 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] creating volume 'volume-1cb82d7b-a650-420d-8119-e1212e99919a' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:36:03.397696 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:03.445931 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:36:03.446304 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:36:03.450051 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5e2dd1-9424-4a92-ac44-6760402e1bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb82d7b-a650-420d-8119-e1212e99919a', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:03.454640 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95cf1ac-69c0-4893-8688-ad16e0fe99f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:03.464111 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Volume volume-1cb82d7b-a650-420d-8119-e1212e99919a (1cb82d7b-a650-420d-8119-e1212e99919a): created successfully Jul 30 21:36:03.468139 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95cf1ac-69c0-4893-8688-ad16e0fe99f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:03.473563 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Flow 'volume_create_manager' (9ab8fff9-8495-4151-adcc-5ffa4c85df57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:36:03.481984 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-76f1897c-5590-4eed-8947-be12a37e4bd6 tempest-GroupSnapshotsTest-1746024774 None] Created volume successfully. Jul 30 21:36:04.712667 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:36:04.731878 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Flow 'volume_create_manager' (a0771186-80c1-410d-bcba-610a32733e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:36:04.738088 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feccc23b-7d0c-43e1-8409-bebe2f9e2d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:04.755065 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feccc23b-7d0c-43e1-8409-bebe2f9e2d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1545589463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30ba9b69-9aef-46c6-a81d-c0f281eecaea,host='ncdv-master-1@ceph#ceph',id=9e2fd718-c87c-4eda-ba0b-27eee247e18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a61164d3b4464c8efba365fa6c2441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:36:05Z,use_quota=True,user_id='d83bbcb9fcd044ffbd701ae31834229c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3bc0de0b-17d1-4df5-8d10-5225d4f11e28),volume_type_id=3bc0de0b-17d1-4df5-8d10-5225d4f11e28)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:04.760226 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3018f0-5338-4901-bb5f-2e9da0a9cf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:04.764191 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3018f0-5338-4901-bb5f-2e9da0a9cf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:04.769085 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3686b077-8a95-4d17-9478-ce0a44a6b3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:04.772988 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3686b077-8a95-4d17-9478-ce0a44a6b3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e2fd718-c87c-4eda-ba0b-27eee247e18e', 'volume_name': 'volume-9e2fd718-c87c-4eda-ba0b-27eee247e18e', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:04.778210 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b58b65-83da-443c-b521-161f0e08da22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:04.781966 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b58b65-83da-443c-b521-161f0e08da22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:04.786494 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8d12f0-af60-460d-bcf8-21941205ad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:04.787686 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Volume 9e2fd718-c87c-4eda-ba0b-27eee247e18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e2fd718-c87c-4eda-ba0b-27eee247e18e', 'volume_size': 1} Jul 30 21:36:04.788076 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] creating volume 'volume-9e2fd718-c87c-4eda-ba0b-27eee247e18e' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:36:04.788701 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:04.834047 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:36:04.834351 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:36:04.838012 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8d12f0-af60-460d-bcf8-21941205ad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e2fd718-c87c-4eda-ba0b-27eee247e18e', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:04.843263 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066c0ddb-85b7-4ea4-a35b-c2129f933c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:04.852384 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Volume volume-9e2fd718-c87c-4eda-ba0b-27eee247e18e (9e2fd718-c87c-4eda-ba0b-27eee247e18e): created successfully Jul 30 21:36:04.856447 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066c0ddb-85b7-4ea4-a35b-c2129f933c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:04.861737 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Flow 'volume_create_manager' (a0771186-80c1-410d-bcba-610a32733e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:36:04.869250 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-954cd3c4-b35d-4312-aa08-a19d2e86ce2b tempest-GroupSnapshotsTest-1746024774 None] Created volume successfully. Jul 30 21:36:05.882704 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2a9f8933-1681-4b6b-8ba9-caf5d390a19f tempest-GroupSnapshotsTest-1746024774 None] Update group completed successfully. Jul 30 21:36:07.025044 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e537bccb-64a8-4dc6-93d6-0af0656e6c4f tempest-GroupSnapshotsTest-1746024774 None] Update group completed successfully. Jul 30 21:36:08.137546 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-71d2d84b-3421-4aa4-937e-94775c02340d tempest-GroupSnapshotsTest-1746024774 None] Update group completed successfully. Jul 30 21:36:09.277442 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-458ffef6-1356-4ccd-8e11-d547ffedbf4e tempest-GroupSnapshotsTest-1746024774 None] Update group completed successfully. Jul 30 21:36:10.597119 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3eb18e06-4171-40ba-b7db-d049a9923c92 tempest-GroupSnapshotsTest-1746024774 None] GroupSnapshot 75a2bd51-efa0-4e49-8623-b83278810ed8: creating. Jul 30 21:36:10.618957 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-3eb18e06-4171-40ba-b7db-d049a9923c92 tempest-GroupSnapshotsTest-1746024774 None] Group snapshot 75a2bd51-efa0-4e49-8623-b83278810ed8: creating. {{(pid=124008) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}} Jul 30 21:36:10.642662 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3eb18e06-4171-40ba-b7db-d049a9923c92 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:11.049104 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3eb18e06-4171-40ba-b7db-d049a9923c92 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:12.118176 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3eb18e06-4171-40ba-b7db-d049a9923c92 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot 75a2bd51-efa0-4e49-8623-b83278810ed8: created successfully Jul 30 21:36:12.851476 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e39e1296-fbfb-4f68-9949-e015ccf82567 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot 75a2bd51-efa0-4e49-8623-b83278810ed8: deleting Jul 30 21:36:12.869823 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-e39e1296-fbfb-4f68-9949-e015ccf82567 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot 75a2bd51-efa0-4e49-8623-b83278810ed8: deleting {{(pid=124008) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}} Jul 30 21:36:12.886126 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e39e1296-fbfb-4f68-9949-e015ccf82567 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:13.067020 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-e39e1296-fbfb-4f68-9949-e015ccf82567 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:14.073770 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=71,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:14.125546 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-e39e1296-fbfb-4f68-9949-e015ccf82567 tempest-GroupSnapshotsTest-1746024774 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-726613495 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-726613495, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:36:14.126266 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-e39e1296-fbfb-4f68-9949-e015ccf82567 tempest-GroupSnapshotsTest-1746024774 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-726613495 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-726613495, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:36:14.140276 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-e39e1296-fbfb-4f68-9949-e015ccf82567 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['a98c78b0-a7cc-4fc8-8056-5d2980cb98ef', '3ce2272a-421a-4d39-b35f-830662380cd6', '04c1728d-ddbc-448f-9964-0ca1b9eccc56', '21e07591-af16-47e0-a830-660cc12a52e8'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:14.206448 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=22,cinder:SELECT=75,cinder:DELETE=1,cinder:INSERT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:14.227933 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-e39e1296-fbfb-4f68-9949-e015ccf82567 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['76e8da6d-9256-41f9-8233-5ba1199fd12e', 'ad6d902f-abb4-465d-9758-790fca104d1d', '31c8249c-ccea-466f-ac38-227f491d5138', 'bfa3f9ad-5f8c-4f43-9f71-6a14ebe27c43'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:14.268515 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-e39e1296-fbfb-4f68-9949-e015ccf82567 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot 75a2bd51-efa0-4e49-8623-b83278810ed8: deleted successfully Jul 30 21:36:15.389464 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:15.428728 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:36:15.429153 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] Volume volume-1cb82d7b-a650-420d-8119-e1212e99919a is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:36:15.433142 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] deleting rbd volume volume-1cb82d7b-a650-420d-8119-e1212e99919a {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:36:15.559573 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:15.594452 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:36:15.594885 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] Volume volume-9e2fd718-c87c-4eda-ba0b-27eee247e18e is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:36:15.598591 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] deleting rbd volume volume-9e2fd718-c87c-4eda-ba0b-27eee247e18e {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:36:15.771156 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['eae91eae-b038-4e6b-8855-b1a135e52a1e'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:15.789086 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-726613495 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-726613495, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:36:15.802429 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['4fb9f156-a5e4-4f7f-867a-84f6c3de64e2', 'd25e0147-2ba4-467c-b92b-5a19626e2b20', 'bdd28bf7-eec5-4bfb-86c1-ea1dc82c0174', '8fc523e3-7ef8-4621-8568-40018e32e703'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:15.873930 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['ed04ce31-3439-4923-8f0b-b21d9fe2dae7', 'eed7a5c6-68a9-4591-9d83-04d4f2ec7a2e', 'ced1e992-6ac3-41cc-b790-3cdfff0ca825', '42207981-4681-4711-a19f-7baa866cae26'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:15.945083 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:15.971830 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:16.003191 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:36:16.007380 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-543ad1c9-7d49-4b24-add6-9399bdd593d3 tempest-GroupSnapshotsTest-1746024774 None] Delete group completed successfully. Jul 30 21:36:16.077352 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:36:16.078013 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:16.100217 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:16.124781 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:36:16.733190 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5e94bacf-f785-413e-83a4-ada97869b785 tempest-GroupSnapshotsTest-1746024774 None] Group tempest-GroupSnapshotsTest-Group-2058736910: creating Jul 30 21:36:16.750482 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5e94bacf-f785-413e-83a4-ada97869b785 tempest-GroupSnapshotsTest-1746024774 None] Group tempest-GroupSnapshotsTest-Group-2058736910: created successfully Jul 30 21:36:16.760158 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5e94bacf-f785-413e-83a4-ada97869b785 tempest-GroupSnapshotsTest-1746024774 None] Create group completed successfully. Jul 30 21:36:18.120180 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:36:18.139596 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Flow 'volume_create_manager' (8daa2918-6087-4778-a852-c000f9bb002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:36:18.146092 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1931b8b4-19d7-4b43-8649-4a4b303960bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:18.164108 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1931b8b4-19d7-4b43-8649-4a4b303960bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-19924563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=386a20f2-b89a-47cf-9a62-f26e3beb5109,host='ncdv-master-1@ceph#ceph',id=379043a0-2b72-4126-abab-2f2030b7cec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a61164d3b4464c8efba365fa6c2441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:36:18Z,use_quota=True,user_id='d83bbcb9fcd044ffbd701ae31834229c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0c34951-ff47-47a4-88e7-079b803eae06),volume_type_id=e0c34951-ff47-47a4-88e7-079b803eae06)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:18.169479 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2e5b09-510d-430a-a27c-a55b2556386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:18.174085 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2e5b09-510d-430a-a27c-a55b2556386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:18.179118 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20b948b-f7a5-44e4-befd-c7477ab6d519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:18.183215 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20b948b-f7a5-44e4-befd-c7477ab6d519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379043a0-2b72-4126-abab-2f2030b7cec0', 'volume_name': 'volume-379043a0-2b72-4126-abab-2f2030b7cec0', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:18.188095 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9e1384-4731-43bc-b01b-4ab510f60b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:18.191951 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9e1384-4731-43bc-b01b-4ab510f60b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:18.196579 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f053b9-1be3-43ae-9f9b-da8b271e0d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:18.197687 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Volume 379043a0-2b72-4126-abab-2f2030b7cec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379043a0-2b72-4126-abab-2f2030b7cec0', 'volume_size': 1} Jul 30 21:36:18.198072 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] creating volume 'volume-379043a0-2b72-4126-abab-2f2030b7cec0' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:36:18.198801 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:18.245461 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:36:18.245754 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:36:18.249678 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f053b9-1be3-43ae-9f9b-da8b271e0d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379043a0-2b72-4126-abab-2f2030b7cec0', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:18.254072 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f7a683-ca2a-476f-a213-b35f9d7f2709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:18.263379 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Volume volume-379043a0-2b72-4126-abab-2f2030b7cec0 (379043a0-2b72-4126-abab-2f2030b7cec0): created successfully Jul 30 21:36:18.266765 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f7a683-ca2a-476f-a213-b35f9d7f2709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:18.272071 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Flow 'volume_create_manager' (8daa2918-6087-4778-a852-c000f9bb002e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:36:18.280081 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-90629d40-d585-4402-b613-446ec65557cb tempest-GroupSnapshotsTest-1746024774 None] Created volume successfully. Jul 30 21:36:18.282309 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=54,cinder:INSERT=11,cinder:UPDATE=35 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:19.356011 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-daf3a989-b867-46fa-9eed-dfcadce7b559 tempest-GroupSnapshotsTest-1746024774 None] GroupSnapshot d99b1f6f-dcd3-44f8-b138-870168066b23: creating. Jul 30 21:36:19.369629 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-daf3a989-b867-46fa-9eed-dfcadce7b559 tempest-GroupSnapshotsTest-1746024774 None] Group snapshot d99b1f6f-dcd3-44f8-b138-870168066b23: creating. {{(pid=124008) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}} Jul 30 21:36:19.386379 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-daf3a989-b867-46fa-9eed-dfcadce7b559 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:20.181929 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-daf3a989-b867-46fa-9eed-dfcadce7b559 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot d99b1f6f-dcd3-44f8-b138-870168066b23: created successfully Jul 30 21:36:20.583503 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-96738b75-31f5-4d34-83c9-daece15b2fc5 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot d99b1f6f-dcd3-44f8-b138-870168066b23: deleting Jul 30 21:36:20.600378 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-96738b75-31f5-4d34-83c9-daece15b2fc5 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot d99b1f6f-dcd3-44f8-b138-870168066b23: deleting {{(pid=124008) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}} Jul 30 21:36:20.618129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-96738b75-31f5-4d34-83c9-daece15b2fc5 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:21.186098 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=66,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:21.193589 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-96738b75-31f5-4d34-83c9-daece15b2fc5 tempest-GroupSnapshotsTest-1746024774 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-44293415 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-44293415, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:36:21.194360 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-96738b75-31f5-4d34-83c9-daece15b2fc5 tempest-GroupSnapshotsTest-1746024774 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-44293415 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-44293415, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:36:21.209092 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-96738b75-31f5-4d34-83c9-daece15b2fc5 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['6789a99e-5ddb-4b82-ad44-c6f0b739ce58', '0cc3e5fa-8386-4521-b0a9-95ba059ba036', '5eac67b2-d317-4c1b-80ed-f58c2f93014a', '25913a66-c74a-40a4-bfb8-a58d2e163e51'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:21.255775 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-96738b75-31f5-4d34-83c9-daece15b2fc5 tempest-GroupSnapshotsTest-1746024774 None] group_snapshot d99b1f6f-dcd3-44f8-b138-870168066b23: deleted successfully Jul 30 21:36:22.046268 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:22.091971 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:36:22.092397 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] Volume volume-379043a0-2b72-4126-abab-2f2030b7cec0 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:36:22.104852 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] deleting rbd volume volume-379043a0-2b72-4126-abab-2f2030b7cec0 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:36:22.276593 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['9f60b6e4-3bc4-4309-a8b8-df887355593f'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:22.293653 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-44293415 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-44293415, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:36:22.307280 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] Created reservations ['94c972d4-4c34-4e7e-ab9d-1ce2ba37b0f8', '0b94f782-8408-48b0-b1ec-e4cf65257bc8', '7f0909c7-2e00-439d-a638-5dfa1f0ccfc8', '06624a5c-30a9-4bf9-8865-2475bbfdf74d'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:22.379022 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:22.401950 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:22.427902 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:36:22.431832 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b9ab69a2-94e7-4b00-8b1f-3de9a4181af7 tempest-GroupSnapshotsTest-1746024774 None] Delete group completed successfully. Jul 30 21:36:29.494520 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:36:29.514897 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Flow 'volume_create_manager' (d76f4431-0ac7-43ea-b96d-57544f0c3ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:36:29.521623 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498fc27d-e680-4bce-bcd2-fbdc73ee9865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:29.537254 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498fc27d-e680-4bce-bcd2-fbdc73ee9865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-785804905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1297b17f-c613-4eaa-8617-0552a873d5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f593dcc1904559bba2c1271fc36ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:36:29Z,use_quota=True,user_id='d8533314435742cf9bcffcb4bcab6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:29.542868 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7dab02-77d2-4a21-ad05-434496f3b049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:29.546961 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7dab02-77d2-4a21-ad05-434496f3b049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:29.551877 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e029dc50-6730-41ac-aec0-3a34f383773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:29.555895 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e029dc50-6730-41ac-aec0-3a34f383773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1297b17f-c613-4eaa-8617-0552a873d5ae', 'volume_name': 'volume-1297b17f-c613-4eaa-8617-0552a873d5ae', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:29.561083 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07aed53b-63f9-4eb7-b2d5-6a34e4ab39fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:29.564832 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07aed53b-63f9-4eb7-b2d5-6a34e4ab39fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:29.569492 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba293267-319f-4a06-8df6-00da3fa2cee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:29.570541 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Volume 1297b17f-c613-4eaa-8617-0552a873d5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1297b17f-c613-4eaa-8617-0552a873d5ae', 'volume_size': 1} Jul 30 21:36:29.570923 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] creating volume 'volume-1297b17f-c613-4eaa-8617-0552a873d5ae' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:36:29.571670 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:29.624009 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:36:29.624646 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:36:29.628249 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba293267-319f-4a06-8df6-00da3fa2cee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1297b17f-c613-4eaa-8617-0552a873d5ae', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:29.632691 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c1c85d-48a4-4ee7-8219-9fd04f2dda54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:29.642514 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Volume volume-1297b17f-c613-4eaa-8617-0552a873d5ae (1297b17f-c613-4eaa-8617-0552a873d5ae): created successfully Jul 30 21:36:29.646443 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c1c85d-48a4-4ee7-8219-9fd04f2dda54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:29.652041 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Flow 'volume_create_manager' (d76f4431-0ac7-43ea-b96d-57544f0c3ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:36:29.660432 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-7146a799-fca7-4901-8708-03c4091f612d tempest-SnapshotsActionsTest-1947228752 None] Created volume successfully. Jul 30 21:36:30.689825 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bdcdff13-1e80-4e74-babb-20f9940933a9 tempest-SnapshotsActionsTest-1947228752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:31.236670 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bdcdff13-1e80-4e74-babb-20f9940933a9 tempest-SnapshotsActionsTest-1947228752 None] Create snapshot completed successfully Jul 30 21:36:32.111399 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1e8418c0-2848-4836-bd55-6da40b6410d2 tempest-SnapshotsActionsTest-1947228752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:32.252340 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-1e8418c0-2848-4836-bd55-6da40b6410d2 tempest-SnapshotsActionsTest-1947228752 None] Create snapshot completed successfully Jul 30 21:36:33.288060 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-593f44cc-5c3a-41f1-a3e3-f246904d9d6a tempest-SnapshotsActionsTest-1727627940 None] Acquiring lock "cinder-44afbab5-d2d0-439f-8d9e-a470d783f66c-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:36:33.298209 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-593f44cc-5c3a-41f1-a3e3-f246904d9d6a tempest-SnapshotsActionsTest-1727627940 None] Lock "cinder-44afbab5-d2d0-439f-8d9e-a470d783f66c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:36:33.299691 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-593f44cc-5c3a-41f1-a3e3-f246904d9d6a tempest-SnapshotsActionsTest-1727627940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:34.278545 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=68,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:34.299585 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-593f44cc-5c3a-41f1-a3e3-f246904d9d6a tempest-SnapshotsActionsTest-1727627940 None] Created reservations ['597dd9ac-5942-4453-af09-7a9ad7187881', '469a6e9d-cf7a-454c-9df6-f9228f131fa4', 'c166f71b-e40c-49b4-97fb-32b48f279329', 'd9808f6b-8f74-4dff-be71-cdee27355e86'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:34.335677 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-593f44cc-5c3a-41f1-a3e3-f246904d9d6a tempest-SnapshotsActionsTest-1727627940 None] Delete snapshot completed successfully. Jul 30 21:36:34.340664 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-593f44cc-5c3a-41f1-a3e3-f246904d9d6a tempest-SnapshotsActionsTest-1727627940 None] Lock "cinder-44afbab5-d2d0-439f-8d9e-a470d783f66c-delete_snapshot" released by "delete_snapshot" :: held 1.042s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:36:34.592696 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-2126b3b4-778f-426a-8523-7d71c62db5df tempest-SnapshotsActionsTest-1947228752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:35.308538 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-2126b3b4-778f-426a-8523-7d71c62db5df tempest-SnapshotsActionsTest-1947228752 None] Create snapshot completed successfully Jul 30 21:36:35.760006 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-de342ce7-d3ea-4638-badd-fa4a90c94eae tempest-SnapshotsActionsTest-1727627940 None] Acquiring lock "cinder-1455aa26-d037-4c24-b35f-24a5b5c4f113-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:36:35.773735 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-de342ce7-d3ea-4638-badd-fa4a90c94eae tempest-SnapshotsActionsTest-1727627940 None] Lock "cinder-1455aa26-d037-4c24-b35f-24a5b5c4f113-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:36:35.773735 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-de342ce7-d3ea-4638-badd-fa4a90c94eae tempest-SnapshotsActionsTest-1727627940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:36.109014 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-de342ce7-d3ea-4638-badd-fa4a90c94eae tempest-SnapshotsActionsTest-1727627940 None] Created reservations ['72b16869-1e6b-4134-9409-85cefd22fe1d', '3afe40f6-0a55-48af-b0d7-584bb096c60c', '63b1fe01-a890-4813-ba2c-7c79ebfae400', 'c6f08423-cc63-431b-8617-a976e3b5293d'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:36.160136 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-de342ce7-d3ea-4638-badd-fa4a90c94eae tempest-SnapshotsActionsTest-1727627940 None] Delete snapshot completed successfully. Jul 30 21:36:36.165243 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-de342ce7-d3ea-4638-badd-fa4a90c94eae tempest-SnapshotsActionsTest-1727627940 None] Lock "cinder-1455aa26-d037-4c24-b35f-24a5b5c4f113-delete_snapshot" released by "delete_snapshot" :: held 0.394s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:36:37.205747 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-b920493b-0028-4cf3-81df-0247188f2966 tempest-SnapshotsActionsTest-1947228752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:38.332322 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=34,cinder:SELECT=57,cinder:INSERT=8,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:38.336851 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-b920493b-0028-4cf3-81df-0247188f2966 tempest-SnapshotsActionsTest-1947228752 None] Create snapshot completed successfully Jul 30 21:36:39.393743 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-750e8e5d-de8a-43c0-86ca-8880dcb31efb tempest-SnapshotsActionsTest-1727627940 None] Acquiring lock "cinder-79caf1b2-494b-42d2-9605-7f32498da067-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:36:39.416386 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-750e8e5d-de8a-43c0-86ca-8880dcb31efb tempest-SnapshotsActionsTest-1727627940 None] Lock "cinder-79caf1b2-494b-42d2-9605-7f32498da067-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:36:39.416386 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-750e8e5d-de8a-43c0-86ca-8880dcb31efb tempest-SnapshotsActionsTest-1727627940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:40.397877 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-750e8e5d-de8a-43c0-86ca-8880dcb31efb tempest-SnapshotsActionsTest-1727627940 None] Created reservations ['162e60aa-f484-455b-9ed7-60ad8d487b24', 'aba260a2-a2fc-4082-9d1d-a01b96bfbcd9', '5c8f86f1-6287-4588-9bea-8a0afa9e3909', 'a3d8db55-2f42-4839-8ded-01bbad5ceceb'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:40.433718 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-750e8e5d-de8a-43c0-86ca-8880dcb31efb tempest-SnapshotsActionsTest-1727627940 None] Delete snapshot completed successfully. Jul 30 21:36:40.439415 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-750e8e5d-de8a-43c0-86ca-8880dcb31efb tempest-SnapshotsActionsTest-1727627940 None] Lock "cinder-79caf1b2-494b-42d2-9605-7f32498da067-delete_snapshot" released by "delete_snapshot" :: held 1.029s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:36:40.731862 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-eae9eea4-1ad0-4a6b-a400-859e1e9eb9c7 tempest-SnapshotsActionsTest-1947228752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:41.385407 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-eae9eea4-1ad0-4a6b-a400-859e1e9eb9c7 tempest-SnapshotsActionsTest-1947228752 None] Create snapshot completed successfully Jul 30 21:36:41.888441 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-021d7892-cc22-4afe-9576-9ea1ede43793 tempest-SnapshotsActionsTest-1727627940 None] Acquiring lock "cinder-b1286a8e-b7d9-4b47-b7ff-e23778805fb8-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:36:41.899320 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-021d7892-cc22-4afe-9576-9ea1ede43793 tempest-SnapshotsActionsTest-1727627940 None] Lock "cinder-b1286a8e-b7d9-4b47-b7ff-e23778805fb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:36:41.900987 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-021d7892-cc22-4afe-9576-9ea1ede43793 tempest-SnapshotsActionsTest-1727627940 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:42.412244 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-021d7892-cc22-4afe-9576-9ea1ede43793 tempest-SnapshotsActionsTest-1727627940 None] Created reservations ['81256c1e-540b-4b34-a5e6-c12cfa88b8c4', 'd2ad21a5-c026-4cde-9c3b-f1a800e1936b', '9a78696c-3c27-454e-b551-333025d64c57', '79397832-d771-4ffc-aad5-0bd8bc491bc3'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:42.447882 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-021d7892-cc22-4afe-9576-9ea1ede43793 tempest-SnapshotsActionsTest-1727627940 None] Delete snapshot completed successfully. Jul 30 21:36:42.454692 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-021d7892-cc22-4afe-9576-9ea1ede43793 tempest-SnapshotsActionsTest-1727627940 None] Lock "cinder-b1286a8e-b7d9-4b47-b7ff-e23778805fb8-delete_snapshot" released by "delete_snapshot" :: held 0.553s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:36:43.369008 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-4b6d1d80-ecdb-4085-9939-04f91929e361 tempest-SnapshotsActionsTest-1947228752 None] Acquiring lock "cinder-15b5a66f-02d2-4a68-98f2-4ad72e21793d-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:36:43.378250 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-4b6d1d80-ecdb-4085-9939-04f91929e361 tempest-SnapshotsActionsTest-1947228752 None] Lock "cinder-15b5a66f-02d2-4a68-98f2-4ad72e21793d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:36:43.380346 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-4b6d1d80-ecdb-4085-9939-04f91929e361 tempest-SnapshotsActionsTest-1947228752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:44.436965 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-4b6d1d80-ecdb-4085-9939-04f91929e361 tempest-SnapshotsActionsTest-1947228752 None] Created reservations ['a0ee65c8-a706-4e7a-90b3-9d7123746519', '56d34071-6663-4e4f-97ab-0dce031e2458', '6a028d34-be8e-4e0a-b81f-bc75efb039ec', 'f38216b0-a2aa-4180-9632-ff9f48dc28e6'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:44.472109 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-4b6d1d80-ecdb-4085-9939-04f91929e361 tempest-SnapshotsActionsTest-1947228752 None] Delete snapshot completed successfully. Jul 30 21:36:44.478065 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-4b6d1d80-ecdb-4085-9939-04f91929e361 tempest-SnapshotsActionsTest-1947228752 None] Lock "cinder-15b5a66f-02d2-4a68-98f2-4ad72e21793d-delete_snapshot" released by "delete_snapshot" :: held 1.100s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:36:45.500186 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] Acquiring lock "cinder-1297b17f-c613-4eaa-8617-0552a873d5ae-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:36:45.508814 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] Lock "cinder-1297b17f-c613-4eaa-8617-0552a873d5ae-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:36:45.526918 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=59,cinder:UPDATE=31,cinder:INSERT=9,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:45.545716 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:45.581706 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:36:45.582131 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] Volume volume-1297b17f-c613-4eaa-8617-0552a873d5ae is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:36:45.587159 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] deleting rbd volume volume-1297b17f-c613-4eaa-8617-0552a873d5ae {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:36:45.743182 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] Created reservations ['214cc9b0-a6f8-4936-8fb0-7c87b0f02a7d', '554c1878-e453-4888-ba9d-3e15a3668f27', 'e130ef45-33e0-4b21-b0f0-f42435b4d4a1', '090b4e38-aa7d-4de9-8fcc-64f607b397ea'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:45.788047 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:45.811464 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:45.835611 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:36:45.839868 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] Deleted volume successfully. Jul 30 21:36:45.853469 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-5d69b8ad-8d03-48bf-bfab-c5585ea4d1ae tempest-SnapshotsActionsTest-1947228752 None] Lock "cinder-1297b17f-c613-4eaa-8617-0552a873d5ae-delete_volume" released by "delete_volume" :: held 0.345s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:36:50.141268 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:36:50.160101 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Flow 'volume_create_manager' (dc233a11-962c-4612-b0aa-b4587b44cce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:36:50.166502 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15a077e-26ef-41cc-8676-b488d9ac4df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:50.182888 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f15a077e-26ef-41cc-8676-b488d9ac4df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1442733490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c9510388-fbc2-4704-a910-f8b4de6a950e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79eef4eae66c425fa1988888bc0217ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:36:50Z,use_quota=True,user_id='d53fe208fe194ef2b59ccbd17ab5c008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9b7c418-319a-46a1-bd8a-fd4279756de7),volume_type_id=d9b7c418-319a-46a1-bd8a-fd4279756de7)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:50.188782 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521c7556-f22a-4eaf-819c-4e87a49be519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:50.192803 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521c7556-f22a-4eaf-819c-4e87a49be519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:50.197777 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8731d9-e925-4e19-bf5c-98d9011c3e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:50.201999 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8731d9-e925-4e19-bf5c-98d9011c3e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9510388-fbc2-4704-a910-f8b4de6a950e', 'volume_name': 'volume-c9510388-fbc2-4704-a910-f8b4de6a950e', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:50.206847 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a174ff64-3fd5-4660-be3d-95b9c7ac9c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:50.210715 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a174ff64-3fd5-4660-be3d-95b9c7ac9c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:50.215423 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d84649-546d-4185-9b60-134108a29e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:50.216614 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Volume c9510388-fbc2-4704-a910-f8b4de6a950e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9510388-fbc2-4704-a910-f8b4de6a950e', 'volume_size': 1} Jul 30 21:36:50.217006 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] creating volume 'volume-c9510388-fbc2-4704-a910-f8b4de6a950e' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:36:50.217771 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:50.270276 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] extra_specs: {} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:36:50.270586 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] extra_specs: {} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:36:50.274262 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d84649-546d-4185-9b60-134108a29e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9510388-fbc2-4704-a910-f8b4de6a950e', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:50.278918 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd73500-acca-4d58-ba8c-479368b3e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:36:50.287801 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Volume volume-c9510388-fbc2-4704-a910-f8b4de6a950e (c9510388-fbc2-4704-a910-f8b4de6a950e): created successfully Jul 30 21:36:50.291348 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd73500-acca-4d58-ba8c-479368b3e2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:36:50.297317 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Flow 'volume_create_manager' (dc233a11-962c-4612-b0aa-b4587b44cce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:36:50.305098 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-11451683-e0d7-4ec3-a2e5-36067e7c8f5e tempest-VolumeTypesAccessTest-83330648 None] Created volume successfully. Jul 30 21:36:51.546707 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] Acquiring lock "cinder-c9510388-fbc2-4704-a910-f8b4de6a950e-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:36:51.560390 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] Lock "cinder-c9510388-fbc2-4704-a910-f8b4de6a950e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:36:51.603712 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:51.632130 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:36:51.632130 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] Volume volume-c9510388-fbc2-4704-a910-f8b4de6a950e is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:36:51.637162 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] deleting rbd volume volume-c9510388-fbc2-4704-a910-f8b4de6a950e {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:36:51.861608 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1037220580 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1037220580, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:36:51.864184 ncdv-master-1 cinder-volume[124008]: WARNING cinder.quota [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1037220580 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1037220580, it is now deprecated. Please use the default quota class for default quota. Jul 30 21:36:51.876246 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=64,cinder:INSERT=8,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:36:51.890272 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] Created reservations ['979b3b22-e621-48ef-b1b9-20e0d8e3df73', '3b63214b-2b2f-4bbe-a862-5d7fd5c4811f', 'a118c170-dd10-4e3a-a102-ba7328ffb1f9', '977ecb2c-9009-4b1d-a935-c88725f8a7ae'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:36:51.958181 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:52.002251 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:36:52.053794 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:36:52.059499 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] Deleted volume successfully. Jul 30 21:36:52.076428 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-5591710c-e506-41c9-891e-ab91b4db8953 tempest-VolumeTypesAccessTest-83330648 None] Lock "cinder-c9510388-fbc2-4704-a910-f8b4de6a950e-delete_volume" released by "delete_volume" :: held 0.516s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:37:04.362502 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:16.079888 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:37:16.080575 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:37:16.114804 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:37:16.149724 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:37:24.369167 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=31,cinder:INSERT=6,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:36.289616 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:37:36.313427 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (d0dd4247-f964-44eb-a7d5-881d96c4cf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:37:36.320368 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494d411c-734d-419e-a914-1fbe2b99fef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:36.338916 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494d411c-734d-419e-a914-1fbe2b99fef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-901129206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9a06fcee-7d32-49c4-92e9-2f314b858afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc59858bd4e749cab7d1d772d65e4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:37:36Z,use_quota=True,user_id='e062653d52144a3a91277e045033f27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:36.344787 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863c609c-ada6-47fb-a869-e145addfa88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:36.349454 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863c609c-ada6-47fb-a869-e145addfa88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:36.354911 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40ad131-8786-456e-9400-13705dc4864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:36.471481 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40ad131-8786-456e-9400-13705dc4864a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a06fcee-7d32-49c4-92e9-2f314b858afe', 'volume_name': 'volume-9a06fcee-7d32-49c4-92e9-2f314b858afe', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:36.477340 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77545bc1-d719-4d3b-95be-47157df5aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:36.481999 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77545bc1-d719-4d3b-95be-47157df5aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:36.498607 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f7120f-b60d-4356-90c4-125a0dec513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:36.501337 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Volume 9a06fcee-7d32-49c4-92e9-2f314b858afe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a06fcee-7d32-49c4-92e9-2f314b858afe', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:37:36.502275 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Cloning 9a06fcee-7d32-49c4-92e9-2f314b858afe from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:37:36.503891 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:37:36.514844 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:37:36.536962 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 37, 36, 521043)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:37:36.538171 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:37:36.539066 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:37:36.545773 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.031s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:37:36.547228 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:37:36.555215 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 37, 36, 551820)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:37:36.556079 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:37:36.556797 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:37:36.576174 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:37:36.688513 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] creating snapshot='volume-9a06fcee-7d32-49c4-92e9-2f314b858afe.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:37:37.116641 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-9a06fcee-7d32-49c4-92e9-2f314b858afe.clone_snap' to 'volume-9a06fcee-7d32-49c4-92e9-2f314b858afe' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:37:37.290427 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:37:37.292551 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:37:37.293499 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:37:37.318916 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:37:37.319835 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Marking volume 9a06fcee-7d32-49c4-92e9-2f314b858afe as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:37:37.328279 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to 9a06fcee-7d32-49c4-92e9-2f314b858afe. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:37:37.328643 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Creating volume glance metadata for volume 9a06fcee-7d32-49c4-92e9-2f314b858afe backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:37:37.390294 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f7120f-b60d-4356-90c4-125a0dec513d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a06fcee-7d32-49c4-92e9-2f314b858afe', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:37.396596 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b323fc7-9989-4347-95b0-a8417378ae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:37.405331 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Volume volume-9a06fcee-7d32-49c4-92e9-2f314b858afe (9a06fcee-7d32-49c4-92e9-2f314b858afe): created successfully Jul 30 21:37:37.409023 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b323fc7-9989-4347-95b0-a8417378ae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:37.414460 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (d0dd4247-f964-44eb-a7d5-881d96c4cf07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:37:37.423093 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-07908aba-466d-4c03-ad21-04670cf613c6 tempest-TestVolumeBootPattern-1489719531 None] Created volume successfully. Jul 30 21:37:38.745222 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1cb14295-4f9e-4f59-abe8-3e3f17d681ae tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:37:39.242852 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-1cb14295-4f9e-4f59-abe8-3e3f17d681ae tempest-TestVolumeBootPattern-1489719531 None] Create snapshot completed successfully Jul 30 21:37:43.382904 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:37:43.451970 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (b7da1649-6bad-430e-8e2d-db51e07f8ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:37:43.472652 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95bd1f0-3ec9-4193-9873-687422fbf164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:43.520145 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95bd1f0-3ec9-4193-9873-687422fbf164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:37:43Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c193a116-5ef7-48f2-bf73-6d8024b7ed97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc59858bd4e749cab7d1d772d65e4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45f5e5c7-5bfa-451d-8c71-d4ea09971689,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:37:43Z,use_quota=True,user_id='e062653d52144a3a91277e045033f27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:43.540343 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d598253-53f0-4dd3-9eab-f3c65f8b768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:43.545129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d598253-53f0-4dd3-9eab-f3c65f8b768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:43.559973 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b596094-4d93-444a-8b90-36a711ab4dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:43.564069 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b596094-4d93-444a-8b90-36a711ab4dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c193a116-5ef7-48f2-bf73-6d8024b7ed97', 'volume_name': 'volume-c193a116-5ef7-48f2-bf73-6d8024b7ed97', 'volume_size': 1, 'snapshot_id': '45f5e5c7-5bfa-451d-8c71-d4ea09971689'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:43.585204 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912a409f-1c10-40d7-8add-0cd2c4e97ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:43.590584 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912a409f-1c10-40d7-8add-0cd2c4e97ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:43.604137 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9423c48-fdb8-4e8d-ab1d-9a56e2b16b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:43.613632 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Volume c193a116-5ef7-48f2-bf73-6d8024b7ed97: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c193a116-5ef7-48f2-bf73-6d8024b7ed97', 'volume_size': 1, 'snapshot_id': '45f5e5c7-5bfa-451d-8c71-d4ea09971689'} Jul 30 21:37:43.652328 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] cloning volumes/volume-9a06fcee-7d32-49c4-92e9-2f314b858afe@snapshot-45f5e5c7-5bfa-451d-8c71-d4ea09971689 to volume-c193a116-5ef7-48f2-bf73-6d8024b7ed97 {{(pid=124008) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jul 30 21:37:43.654191 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:37:43.825168 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:37:44.079998 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:37:44.080701 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:37:44.135988 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Marking volume c193a116-5ef7-48f2-bf73-6d8024b7ed97 as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:37:44.174433 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Copying metadata from snapshot 45f5e5c7-5bfa-451d-8c71-d4ea09971689 to c193a116-5ef7-48f2-bf73-6d8024b7ed97. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jul 30 21:37:44.252056 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9423c48-fdb8-4e8d-ab1d-9a56e2b16b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c193a116-5ef7-48f2-bf73-6d8024b7ed97', 'volume_size': 1, 'snapshot_id': '45f5e5c7-5bfa-451d-8c71-d4ea09971689'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:44.268429 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d284cbf-1f92-4e3b-b2b4-358c7ae4b6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:37:44.298209 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Volume volume-c193a116-5ef7-48f2-bf73-6d8024b7ed97 (c193a116-5ef7-48f2-bf73-6d8024b7ed97): created successfully Jul 30 21:37:44.304530 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d284cbf-1f92-4e3b-b2b4-358c7ae4b6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:37:44.335816 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (b7da1649-6bad-430e-8e2d-db51e07f8ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:37:44.381479 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=36,cinder:UPDATE=7,cinder:INSERT=23,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:37:44.390141 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-25040070-fffb-46de-97cd-fa4364d4c384 tempest-TestVolumeBootPattern-1489719531 None] Created volume successfully. Jul 30 21:37:46.816871 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-2ee6a9bf-4873-471f-8e89-48bf55b2f422 tempest-TestVolumeBootPattern-1489719531 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:37:47.587996 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-2ee6a9bf-4873-471f-8e89-48bf55b2f422 tempest-TestVolumeBootPattern-1489719531 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.771s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:37:47.590832 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-2ee6a9bf-4873-471f-8e89-48bf55b2f422 tempest-TestVolumeBootPattern-1489719531 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c193a116-5ef7-48f2-bf73-6d8024b7ed97', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'c193a116-5ef7-48f2-bf73-6d8024b7ed97', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:37:47.639270 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-2ee6a9bf-4873-471f-8e89-48bf55b2f422 tempest-TestVolumeBootPattern-1489719531 None] Connection info returned from driver {'name': 'volumes/volume-c193a116-5ef7-48f2-bf73-6d8024b7ed97', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c193a116-5ef7-48f2-bf73-6d8024b7ed97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0e9c6490-dc8a-4766-a2bd-3840ef833136'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:37:47.700246 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-019c40d6-10e3-4580-b43f-03395e652ec0 req-2ee6a9bf-4873-471f-8e89-48bf55b2f422 tempest-TestVolumeBootPattern-1489719531 None] attachment_update completed successfully. Jul 30 21:38:01.091386 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=48,cinder:UPDATE=9,cinder:INSERT=13,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:01.093384 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-8b51ed24-5c6c-40c3-8fbb-88cbbb833c97 tempest-TestVolumeBootPattern-1489719531 None] Terminate volume connection completed successfully. Jul 30 21:38:01.094816 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-8b51ed24-5c6c-40c3-8fbb-88cbbb833c97 tempest-TestVolumeBootPattern-1489719531 None] Deleting attachment 0e9c6490-dc8a-4766-a2bd-3840ef833136. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:38:01.294874 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-c193a116-5ef7-48f2-bf73-6d8024b7ed97-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:38:01.313607 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-c193a116-5ef7-48f2-bf73-6d8024b7ed97-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:38:01.363065 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:01.476708 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:38:01.486148 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] deleting rbd volume volume-c193a116-5ef7-48f2-bf73-6d8024b7ed97 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:38:01.758287 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] Created reservations ['10e24425-c9d9-4a46-b088-ec6e887f5a05', '487cb853-7c70-4e9e-ae90-44170d6b3744', 'f7fdfef5-dcb4-402d-bd74-ae1c741e7343', '5ee60b9c-09ed-4543-9e76-ab0f24958146'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:38:01.830944 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:01.895629 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:01.949336 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:38:01.954065 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] Deleted volume successfully. Jul 30 21:38:01.969405 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-06b13bfc-3f92-4379-9190-ae15821fdb94 req-44449105-d8ad-440a-8a16-c222b12e0c26 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-c193a116-5ef7-48f2-bf73-6d8024b7ed97-delete_volume" released by "delete_volume" :: held 0.656s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:38:02.492786 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-cd7b0c8a-1a71-4003-b1a8-f8960d282bf2 tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-45f5e5c7-5bfa-451d-8c71-d4ea09971689-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:38:02.506169 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-cd7b0c8a-1a71-4003-b1a8-f8960d282bf2 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-45f5e5c7-5bfa-451d-8c71-d4ea09971689-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:38:02.507770 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-cd7b0c8a-1a71-4003-b1a8-f8960d282bf2 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:03.471910 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-cd7b0c8a-1a71-4003-b1a8-f8960d282bf2 tempest-TestVolumeBootPattern-1489719531 None] Created reservations ['0209ce52-fa3b-45ac-a8ff-02350d9c092f', '571244cc-7c45-4eb3-be54-731557a6f135', '97df275d-f77b-463c-a8a4-0efe0b536279', 'bc6ca832-d7fc-43b5-ac82-d73db9e5152a'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:38:03.520440 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-cd7b0c8a-1a71-4003-b1a8-f8960d282bf2 tempest-TestVolumeBootPattern-1489719531 None] Delete snapshot completed successfully. Jul 30 21:38:03.527797 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-cd7b0c8a-1a71-4003-b1a8-f8960d282bf2 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-45f5e5c7-5bfa-451d-8c71-d4ea09971689-delete_snapshot" released by "delete_snapshot" :: held 1.022s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:38:03.617384 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-9a06fcee-7d32-49c4-92e9-2f314b858afe-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:38:03.630278 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-9a06fcee-7d32-49c4-92e9-2f314b858afe-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:38:03.676676 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:03.770872 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:38:03.782997 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] deleting rbd volume volume-9a06fcee-7d32-49c4-92e9-2f314b858afe {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:38:03.954398 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:38:04.005228 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] deleting parent snapshot volume-9a06fcee-7d32-49c4-92e9-2f314b858afe.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:38:04.457363 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] Created reservations ['ee61b62a-fcf1-4e97-882b-0d8b103605c8', '1f3e0127-9206-475d-9352-cb24ceee6e26', 'd06e6d7d-ae78-4010-9f81-28ddf6a578d0', '859e06b6-d840-4656-871c-f45a3789d8a3'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:38:04.502726 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:04.529070 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:04.558411 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:38:04.562703 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] Deleted volume successfully. Jul 30 21:38:04.575678 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-a02d1cb5-7ce5-4061-9092-8f4eb642138e tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-9a06fcee-7d32-49c4-92e9-2f314b858afe-delete_volume" released by "delete_volume" :: held 0.945s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:38:05.351038 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:38:05.372446 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (67884244-eb8a-4ed9-8f91-08d706794a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:38:05.380631 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f944eebc-760f-4546-bb18-5c4112f0255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:05.403008 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f944eebc-760f-4546-bb18-5c4112f0255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-459287213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0a9951e2-181f-496b-9841-f6f5f0a12efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc59858bd4e749cab7d1d772d65e4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:38:05Z,use_quota=True,user_id='e062653d52144a3a91277e045033f27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:05.408899 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376f58d2-1a48-459d-bbb3-f34bcd6b76a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:05.413262 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376f58d2-1a48-459d-bbb3-f34bcd6b76a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:05.418760 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef18e17-9ef0-4f86-9674-554754ee6b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:05.517986 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef18e17-9ef0-4f86-9674-554754ee6b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a9951e2-181f-496b-9841-f6f5f0a12efb', 'volume_name': 'volume-0a9951e2-181f-496b-9841-f6f5f0a12efb', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:05.523234 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16113580-62d4-4d19-ab79-9971cf701e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:05.527424 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16113580-62d4-4d19-ab79-9971cf701e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:05.533133 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43229ca-a4ed-47cb-9c56-418f4dde0aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:05.533798 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Volume 0a9951e2-181f-496b-9841-f6f5f0a12efb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a9951e2-181f-496b-9841-f6f5f0a12efb', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:38:05.534499 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Cloning 0a9951e2-181f-496b-9841-f6f5f0a12efb from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:38:05.535377 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:38:05.545259 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:38:05.556737 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 38, 5, 550142)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:38:05.557981 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:38:05.558460 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:38:05.563358 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:38:05.564373 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:38:05.570736 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 38, 5, 568250)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:38:05.571280 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:38:05.571795 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:38:05.585298 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:05.651498 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] creating snapshot='volume-0a9951e2-181f-496b-9841-f6f5f0a12efb.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:38:06.155072 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-0a9951e2-181f-496b-9841-f6f5f0a12efb.clone_snap' to 'volume-0a9951e2-181f-496b-9841-f6f5f0a12efb' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:38:06.340988 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:38:06.342334 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:38:06.342928 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:38:06.365602 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:38:06.366618 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Marking volume 0a9951e2-181f-496b-9841-f6f5f0a12efb as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:38:06.376884 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to 0a9951e2-181f-496b-9841-f6f5f0a12efb. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:38:06.377344 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Creating volume glance metadata for volume 0a9951e2-181f-496b-9841-f6f5f0a12efb backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:38:06.409494 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=65,cinder:UPDATE=25,cinder:INSERT=9,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:06.439597 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43229ca-a4ed-47cb-9c56-418f4dde0aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9951e2-181f-496b-9841-f6f5f0a12efb', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:06.444857 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b15b86-437a-4a42-bfb1-7c8767aee84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:06.454888 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Volume volume-0a9951e2-181f-496b-9841-f6f5f0a12efb (0a9951e2-181f-496b-9841-f6f5f0a12efb): created successfully Jul 30 21:38:06.459202 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b15b86-437a-4a42-bfb1-7c8767aee84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:06.465600 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (67884244-eb8a-4ed9-8f91-08d706794a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:38:06.474716 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-98ea6da7-ea29-4145-88ac-1e0b53e8b9b6 tempest-TestVolumeBootPattern-1489719531 None] Created volume successfully. Jul 30 21:38:09.476192 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c req-1b3364dc-3d2e-4d1c-93be-939d1c7b2aec tempest-TestVolumeBootPattern-1489719531 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:38:10.263851 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c req-1b3364dc-3d2e-4d1c-93be-939d1c7b2aec tempest-TestVolumeBootPattern-1489719531 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.787s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:38:10.264642 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c req-1b3364dc-3d2e-4d1c-93be-939d1c7b2aec tempest-TestVolumeBootPattern-1489719531 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0a9951e2-181f-496b-9841-f6f5f0a12efb', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '0a9951e2-181f-496b-9841-f6f5f0a12efb', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:38:10.288543 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c req-1b3364dc-3d2e-4d1c-93be-939d1c7b2aec tempest-TestVolumeBootPattern-1489719531 None] Connection info returned from driver {'name': 'volumes/volume-0a9951e2-181f-496b-9841-f6f5f0a12efb', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0a9951e2-181f-496b-9841-f6f5f0a12efb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a870bf4d-d55e-462f-b524-c3ccf4d10a1e'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:38:10.309011 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=55,cinder:INSERT=15,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:10.341189 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-e21a6e28-9821-49b1-b8d3-06f92cd59a2c req-1b3364dc-3d2e-4d1c-93be-939d1c7b2aec tempest-TestVolumeBootPattern-1489719531 None] attachment_update completed successfully. Jul 30 21:38:16.079019 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:38:16.079974 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:16.107184 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:16.130995 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:38:19.654594 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f req-454ea269-192a-4d61-a56c-75e78629f41b tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:20.561668 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-7b79cac5-abd4-4f3b-aec5-ad7269f4fc1f req-454ea269-192a-4d61-a56c-75e78629f41b tempest-TestVolumeBootPattern-1489719531 None] Create snapshot completed successfully Jul 30 21:38:23.607185 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:38:23.638049 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (26b9e90b-f40b-47c2-8eca-9498a506c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:38:23.644487 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ae29bc-f081-416c-92af-ccab6ef6113b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:23.661096 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ae29bc-f081-416c-92af-ccab6ef6113b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:38:23Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=52da078c-1f02-46d0-847c-26927627ec27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc59858bd4e749cab7d1d772d65e4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f895c02e-4229-41e8-a0ac-285e78ccdb91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:38:24Z,use_quota=True,user_id='e062653d52144a3a91277e045033f27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:23.666626 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a560c5ab-3c9c-438e-9c49-3c321cb6f122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:23.670958 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a560c5ab-3c9c-438e-9c49-3c321cb6f122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:23.677860 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac53845-853e-4f99-b1a7-f5e2807cef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:23.682052 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac53845-853e-4f99-b1a7-f5e2807cef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52da078c-1f02-46d0-847c-26927627ec27', 'volume_name': 'volume-52da078c-1f02-46d0-847c-26927627ec27', 'volume_size': 1, 'snapshot_id': 'f895c02e-4229-41e8-a0ac-285e78ccdb91'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:23.687350 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24723c3d-f489-46c5-88c7-1daeebd6482a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:23.691103 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24723c3d-f489-46c5-88c7-1daeebd6482a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:23.695686 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2bec12-3231-4ce1-856d-50e6a2a489e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:23.696790 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Volume 52da078c-1f02-46d0-847c-26927627ec27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52da078c-1f02-46d0-847c-26927627ec27', 'volume_size': 1, 'snapshot_id': 'f895c02e-4229-41e8-a0ac-285e78ccdb91'} Jul 30 21:38:23.721092 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] cloning volumes/volume-0a9951e2-181f-496b-9841-f6f5f0a12efb@snapshot-f895c02e-4229-41e8-a0ac-285e78ccdb91 to volume-52da078c-1f02-46d0-847c-26927627ec27 {{(pid=124008) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jul 30 21:38:23.721933 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:23.822899 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:23.973719 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:38:23.974180 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:38:23.997720 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Marking volume 52da078c-1f02-46d0-847c-26927627ec27 as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:38:24.002597 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Copying metadata from snapshot f895c02e-4229-41e8-a0ac-285e78ccdb91 to 52da078c-1f02-46d0-847c-26927627ec27. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jul 30 21:38:24.039901 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2bec12-3231-4ce1-856d-50e6a2a489e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52da078c-1f02-46d0-847c-26927627ec27', 'volume_size': 1, 'snapshot_id': 'f895c02e-4229-41e8-a0ac-285e78ccdb91'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:24.045272 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca055342-a065-4c60-8a34-fd5676f5fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:38:24.055998 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Volume volume-52da078c-1f02-46d0-847c-26927627ec27 (52da078c-1f02-46d0-847c-26927627ec27): created successfully Jul 30 21:38:24.060095 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca055342-a065-4c60-8a34-fd5676f5fddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:38:24.065438 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (26b9e90b-f40b-47c2-8eca-9498a506c37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:38:24.084659 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-9b1551b4-1d88-4288-a64d-801ab866c94f tempest-TestVolumeBootPattern-1489719531 None] Created volume successfully. Jul 30 21:38:26.887956 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-34a0d004-0a05-472e-818b-2a838d168587 req-aa402d02-3746-478d-9c49-b3acac761069 tempest-TestVolumeBootPattern-1489719531 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:38:27.716661 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-34a0d004-0a05-472e-818b-2a838d168587 req-aa402d02-3746-478d-9c49-b3acac761069 tempest-TestVolumeBootPattern-1489719531 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.829s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:38:27.717504 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-34a0d004-0a05-472e-818b-2a838d168587 req-aa402d02-3746-478d-9c49-b3acac761069 tempest-TestVolumeBootPattern-1489719531 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-52da078c-1f02-46d0-847c-26927627ec27', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '52da078c-1f02-46d0-847c-26927627ec27', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:38:27.744368 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-aa402d02-3746-478d-9c49-b3acac761069 tempest-TestVolumeBootPattern-1489719531 None] Connection info returned from driver {'name': 'volumes/volume-52da078c-1f02-46d0-847c-26927627ec27', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '52da078c-1f02-46d0-847c-26927627ec27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '21b14c12-8bb3-4107-91ff-a3cf27cf907f'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:38:27.798387 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-34a0d004-0a05-472e-818b-2a838d168587 req-aa402d02-3746-478d-9c49-b3acac761069 tempest-TestVolumeBootPattern-1489719531 None] attachment_update completed successfully. Jul 30 21:38:39.300016 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=46,cinder:UPDATE=8,cinder:DELETE=2,cinder:INSERT=13 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:39.305555 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-3e8526e3-333d-4892-9ae0-43ca72e6cdf0 tempest-TestVolumeBootPattern-1489719531 None] Terminate volume connection completed successfully. Jul 30 21:38:39.306302 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-3e8526e3-333d-4892-9ae0-43ca72e6cdf0 tempest-TestVolumeBootPattern-1489719531 None] Deleting attachment 21b14c12-8bb3-4107-91ff-a3cf27cf907f. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:38:39.440307 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-52da078c-1f02-46d0-847c-26927627ec27-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:38:39.453802 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-52da078c-1f02-46d0-847c-26927627ec27-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:38:39.507280 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:39.615352 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:38:39.624636 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] deleting rbd volume volume-52da078c-1f02-46d0-847c-26927627ec27 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:38:39.785969 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] Created reservations ['ba9945e0-3023-4f6f-b494-e516be0ec1ac', 'e63ba5c6-e18b-4bd8-90ae-009b044be522', '7d2fc09f-70d4-4474-819f-8c7cb682486c', '6a5412b0-09a6-4e68-a874-4dac042d3508'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:38:39.837109 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:39.876066 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:39.923730 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:38:39.935638 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] Deleted volume successfully. Jul 30 21:38:39.952794 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-69aa3ce8-a6bb-4ae7-bc52-a3894c31dd52 req-c352f829-4687-4dd3-9af1-b163603e18fe tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-52da078c-1f02-46d0-847c-26927627ec27-delete_volume" released by "delete_volume" :: held 0.499s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:38:40.617082 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-55ba15f3-6905-48b8-a8a6-421bc6375f28 tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-f895c02e-4229-41e8-a0ac-285e78ccdb91-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:38:40.627015 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-55ba15f3-6905-48b8-a8a6-421bc6375f28 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-f895c02e-4229-41e8-a0ac-285e78ccdb91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:38:40.628949 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-55ba15f3-6905-48b8-a8a6-421bc6375f28 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:38:44.431308 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=58,cinder:INSERT=13,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:38:54.434456 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:10.774240 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-55ba15f3-6905-48b8-a8a6-421bc6375f28 tempest-TestVolumeBootPattern-1489719531 None] Created reservations ['4209be75-2f6f-4414-9dd7-25e497a86625', 'e603fa82-aa28-450b-b1d7-587f21185e6e', '280a073e-684d-4292-b91b-60b829d31860', '7d665a0c-0958-41a6-8ef0-6322d9dc374e'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:39:10.813795 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-55ba15f3-6905-48b8-a8a6-421bc6375f28 tempest-TestVolumeBootPattern-1489719531 None] Delete snapshot completed successfully. Jul 30 21:39:10.818263 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-55ba15f3-6905-48b8-a8a6-421bc6375f28 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-f895c02e-4229-41e8-a0ac-285e78ccdb91-delete_snapshot" released by "delete_snapshot" :: held 30.191s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:39:13.749508 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-66ef96d7-b704-4e4e-8b4c-ee9d58f9c563 tempest-TestVolumeBootPattern-1489719531 None] Terminate volume connection completed successfully. Jul 30 21:39:13.750120 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-66ef96d7-b704-4e4e-8b4c-ee9d58f9c563 tempest-TestVolumeBootPattern-1489719531 None] Deleting attachment a870bf4d-d55e-462f-b524-c3ccf4d10a1e. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:39:13.862199 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-0a9951e2-181f-496b-9841-f6f5f0a12efb-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:39:13.871727 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-0a9951e2-181f-496b-9841-f6f5f0a12efb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:39:13.904687 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:39:13.975390 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:39:13.981856 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] deleting rbd volume volume-0a9951e2-181f-496b-9841-f6f5f0a12efb {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:39:14.210466 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:39:14.246827 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] deleting parent snapshot volume-0a9951e2-181f-496b-9841-f6f5f0a12efb.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:39:14.871420 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=18,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:14.907879 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] Created reservations ['2cf9b626-77af-4b58-adcb-7952fc1581be', 'e0aa31d8-38b5-43ad-8aec-80522d028265', '537190db-dc91-4cbd-befa-95be48d28b07', '2423c976-d0f0-4f55-a16b-fe953dd32f38'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:39:14.950063 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:39:14.973215 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:39:15.001913 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:39:15.007058 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] Deleted volume successfully. Jul 30 21:39:15.019332 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-f7723c84-5efe-4cb7-9e30-4e51e2e2a815 req-71210291-3f57-4e11-8e20-5aefdc623109 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-0a9951e2-181f-496b-9841-f6f5f0a12efb-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:39:16.076058 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:39:16.076938 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:39:16.116161 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:39:16.150027 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:39:17.333587 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:39:17.353425 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (e2bf8760-9cc5-4789-9ca5-d648ca379e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:39:17.359700 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991758a0-fdcb-4fc0-8e19-822836c4558a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:39:17.375145 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991758a0-fdcb-4fc0-8e19-822836c4558a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2006324554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2d47a2ac-e152-4e83-b953-0485a902e560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc59858bd4e749cab7d1d772d65e4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:39:17Z,use_quota=True,user_id='e062653d52144a3a91277e045033f27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:39:17.380599 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b306e7c-7eca-4d92-88fd-e2eb28d61fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:39:17.385047 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b306e7c-7eca-4d92-88fd-e2eb28d61fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:39:17.389923 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0605b632-7b70-4dd8-85d2-e4adffb59610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:39:17.468996 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0605b632-7b70-4dd8-85d2-e4adffb59610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d47a2ac-e152-4e83-b953-0485a902e560', 'volume_name': 'volume-2d47a2ac-e152-4e83-b953-0485a902e560', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:39:17.473871 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec3aa91-1b08-45d1-903a-b776ce4e5644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:39:17.477705 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec3aa91-1b08-45d1-903a-b776ce4e5644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:39:17.482271 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbd8cd0-32b8-4a14-ae24-c46ac644d0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:39:17.483394 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Volume 2d47a2ac-e152-4e83-b953-0485a902e560: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d47a2ac-e152-4e83-b953-0485a902e560', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 21:39:17.483962 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Cloning 2d47a2ac-e152-4e83-b953-0485a902e560 from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 21:39:17.484688 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:39:17.494184 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:39:17.505958 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 39, 17, 500459)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:39:17.506633 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:39:17.507061 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 21:39:17.511935 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:39:17.512932 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 21:39:17.518653 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 21, 39, 17, 516402)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 21:39:17.519062 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 21:39:17.519495 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 21:39:17.531852 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:39:17.579394 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] creating snapshot='volume-2d47a2ac-e152-4e83-b953-0485a902e560.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 21:39:17.888962 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-2d47a2ac-e152-4e83-b953-0485a902e560.clone_snap' to 'volume-2d47a2ac-e152-4e83-b953-0485a902e560' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 21:39:18.002228 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:39:18.003873 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:39:18.003873 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:39:18.018747 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 21:39:18.019391 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Marking volume 2d47a2ac-e152-4e83-b953-0485a902e560 as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:39:18.027790 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to 2d47a2ac-e152-4e83-b953-0485a902e560. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 21:39:18.028206 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Creating volume glance metadata for volume 2d47a2ac-e152-4e83-b953-0485a902e560 backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 21:39:18.078955 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbd8cd0-32b8-4a14-ae24-c46ac644d0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d47a2ac-e152-4e83-b953-0485a902e560', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:39:18.083556 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbab3e54-fb71-427a-b165-ebbe275168e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:39:18.092283 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Volume volume-2d47a2ac-e152-4e83-b953-0485a902e560 (2d47a2ac-e152-4e83-b953-0485a902e560): created successfully Jul 30 21:39:18.095748 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbab3e54-fb71-427a-b165-ebbe275168e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:39:18.101125 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (e2bf8760-9cc5-4789-9ca5-d648ca379e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:39:18.108609 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-7e1d0ea4-ea01-401e-a065-a097277ac2dc tempest-TestVolumeBootPattern-1489719531 None] Created volume successfully. Jul 30 21:39:20.294062 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 req-a3201f43-c3fb-4a50-a5ed-1013844b2a7b tempest-TestVolumeBootPattern-1489719531 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:39:21.046300 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 req-a3201f43-c3fb-4a50-a5ed-1013844b2a7b tempest-TestVolumeBootPattern-1489719531 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.752s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:39:21.046904 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 req-a3201f43-c3fb-4a50-a5ed-1013844b2a7b tempest-TestVolumeBootPattern-1489719531 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2d47a2ac-e152-4e83-b953-0485a902e560', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '2d47a2ac-e152-4e83-b953-0485a902e560', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:39:21.072487 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 req-a3201f43-c3fb-4a50-a5ed-1013844b2a7b tempest-TestVolumeBootPattern-1489719531 None] Connection info returned from driver {'name': 'volumes/volume-2d47a2ac-e152-4e83-b953-0485a902e560', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2d47a2ac-e152-4e83-b953-0485a902e560', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aaaef86a-3e45-43d2-ba72-a726bb844fd6'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:39:21.122014 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-f34bd4c8-cc3d-4391-9151-dd55785c2d51 req-a3201f43-c3fb-4a50-a5ed-1013844b2a7b tempest-TestVolumeBootPattern-1489719531 None] attachment_update completed successfully. Jul 30 21:39:24.873504 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=62,cinder:UPDATE=15,cinder:INSERT=14,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:44.878962 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:39:54.882507 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=34,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:40:16.075612 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:40:16.076464 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:40:16.101347 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:40:16.126410 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:40:24.880575 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:40:34.886467 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:40:54.893730 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:04.901237 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:16.072569 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:41:16.073579 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:41:16.100312 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:41:16.128383 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:41:24.906555 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:24.907309 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:41:39.668420 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-862f0920-066e-43b4-81af-b902bffb2476 req-2959bbb6-7c2d-4b11-8254-d2f147d49bde tempest-TestVolumeBootPattern-1489719531 None] Terminate volume connection completed successfully. Jul 30 21:41:39.669034 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-862f0920-066e-43b4-81af-b902bffb2476 req-2959bbb6-7c2d-4b11-8254-d2f147d49bde tempest-TestVolumeBootPattern-1489719531 None] Deleting attachment aaaef86a-3e45-43d2-ba72-a726bb844fd6. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:41:42.904726 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-606d5196-70ff-437a-b172-093327c38c6d req-f7b76698-2d08-4321-b22b-fe610598c277 tempest-TestVolumeBootPattern-1489719531 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:41:43.714253 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-606d5196-70ff-437a-b172-093327c38c6d req-f7b76698-2d08-4321-b22b-fe610598c277 tempest-TestVolumeBootPattern-1489719531 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.809s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:41:43.715088 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-606d5196-70ff-437a-b172-093327c38c6d req-f7b76698-2d08-4321-b22b-fe610598c277 tempest-TestVolumeBootPattern-1489719531 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2d47a2ac-e152-4e83-b953-0485a902e560', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '2d47a2ac-e152-4e83-b953-0485a902e560', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:41:43.738874 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-606d5196-70ff-437a-b172-093327c38c6d req-f7b76698-2d08-4321-b22b-fe610598c277 tempest-TestVolumeBootPattern-1489719531 None] Connection info returned from driver {'name': 'volumes/volume-2d47a2ac-e152-4e83-b953-0485a902e560', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2d47a2ac-e152-4e83-b953-0485a902e560', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f2ba8596-2224-4314-971f-d21f6d76a7d1'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:41:43.790867 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-606d5196-70ff-437a-b172-093327c38c6d req-f7b76698-2d08-4321-b22b-fe610598c277 tempest-TestVolumeBootPattern-1489719531 None] attachment_update completed successfully. Jul 30 21:41:54.916881 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=5,cinder:SELECT=17 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:42:04.914908 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=18,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:42:16.074885 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:42:16.075807 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:42:16.105206 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:42:16.130970 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:42:24.924214 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:42:44.936890 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:42:54.935343 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:14.946338 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:14.947100 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:16.076622 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:43:16.077277 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:43:16.100093 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:43:16.123744 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:43:32.768728 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-1310a274-b0c4-47aa-84a1-e46ebf21ee26 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:43:33.758692 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-1310a274-b0c4-47aa-84a1-e46ebf21ee26 tempest-TestVolumeBootPattern-1489719531 None] Create snapshot completed successfully Jul 30 21:43:35.197753 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:43:35.228597 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (c9ec647c-620a-477b-953f-3ae3081b018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:43:35.235793 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e3d4d8-e41e-4336-94fa-5a4671dc7109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:43:35.251965 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e3d4d8-e41e-4336-94fa-5a4671dc7109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-923119070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5412cf53-2389-453b-9c5e-00272002546c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc59858bd4e749cab7d1d772d65e4111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b964007e-fb6b-4f2a-8bea-0c2991535373,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:43:35Z,use_quota=True,user_id='e062653d52144a3a91277e045033f27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:43:35.257186 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbf7597-f378-4330-9d91-de928599032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:43:35.261586 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbf7597-f378-4330-9d91-de928599032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:43:35.266643 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9193e825-7359-4e02-aaf2-4515f0c034fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:43:35.270610 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9193e825-7359-4e02-aaf2-4515f0c034fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5412cf53-2389-453b-9c5e-00272002546c', 'volume_name': 'volume-5412cf53-2389-453b-9c5e-00272002546c', 'volume_size': 1, 'snapshot_id': 'b964007e-fb6b-4f2a-8bea-0c2991535373'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:43:35.275606 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82327e7-0c78-4d58-ad40-7fb69130aeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:43:35.279463 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82327e7-0c78-4d58-ad40-7fb69130aeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:43:35.284625 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dd937b-de1a-4468-99ef-04a6eb28427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:43:35.285676 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Volume 5412cf53-2389-453b-9c5e-00272002546c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5412cf53-2389-453b-9c5e-00272002546c', 'volume_size': 1, 'snapshot_id': 'b964007e-fb6b-4f2a-8bea-0c2991535373'} Jul 30 21:43:35.309922 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] cloning volumes/volume-2d47a2ac-e152-4e83-b953-0485a902e560@snapshot-b964007e-fb6b-4f2a-8bea-0c2991535373 to volume-5412cf53-2389-453b-9c5e-00272002546c {{(pid=124008) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jul 30 21:43:35.310500 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:43:35.368978 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:43:35.479490 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:43:35.479805 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:43:35.499627 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Marking volume 5412cf53-2389-453b-9c5e-00272002546c as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 21:43:35.506816 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Copying metadata from snapshot b964007e-fb6b-4f2a-8bea-0c2991535373 to 5412cf53-2389-453b-9c5e-00272002546c. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jul 30 21:43:35.541823 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dd937b-de1a-4468-99ef-04a6eb28427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5412cf53-2389-453b-9c5e-00272002546c', 'volume_size': 1, 'snapshot_id': 'b964007e-fb6b-4f2a-8bea-0c2991535373'}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:43:35.546255 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb87437-e7c9-48eb-9405-d63b2d63b784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:43:35.554457 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Volume volume-5412cf53-2389-453b-9c5e-00272002546c (5412cf53-2389-453b-9c5e-00272002546c): created successfully Jul 30 21:43:35.557882 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb87437-e7c9-48eb-9405-d63b2d63b784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:43:35.563205 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Flow 'volume_create_manager' (c9ec647c-620a-477b-953f-3ae3081b018c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:43:35.575485 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-294c712e-37a2-4bf2-8d70-39ee85c7692d tempest-TestVolumeBootPattern-1489719531 None] Created volume successfully. Jul 30 21:43:38.303639 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-942c0eb5-7685-4e66-9a6d-1828e0729479 req-df02b7d1-f069-412d-8398-2fe96839b4c3 tempest-TestVolumeBootPattern-1489719531 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:43:39.068943 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-942c0eb5-7685-4e66-9a6d-1828e0729479 req-df02b7d1-f069-412d-8398-2fe96839b4c3 tempest-TestVolumeBootPattern-1489719531 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.765s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:43:39.069946 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-942c0eb5-7685-4e66-9a6d-1828e0729479 req-df02b7d1-f069-412d-8398-2fe96839b4c3 tempest-TestVolumeBootPattern-1489719531 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5412cf53-2389-453b-9c5e-00272002546c', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '5412cf53-2389-453b-9c5e-00272002546c', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:43:39.106600 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-942c0eb5-7685-4e66-9a6d-1828e0729479 req-df02b7d1-f069-412d-8398-2fe96839b4c3 tempest-TestVolumeBootPattern-1489719531 None] Connection info returned from driver {'name': 'volumes/volume-5412cf53-2389-453b-9c5e-00272002546c', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5412cf53-2389-453b-9c5e-00272002546c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7d90ccd5-bbde-45d0-8d93-03bdf549dbd3'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:43:39.161851 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-942c0eb5-7685-4e66-9a6d-1828e0729479 req-df02b7d1-f069-412d-8398-2fe96839b4c3 tempest-TestVolumeBootPattern-1489719531 None] attachment_update completed successfully. Jul 30 21:43:54.948736 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=7,cinder:SELECT=33,cinder:INSERT=12,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:43:54.950756 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=39,cinder:UPDATE=6,cinder:INSERT=12 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:44:14.953223 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:44:16.082049 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:44:16.082954 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:44:16.109882 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:44:16.133868 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:44:34.955811 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:44:54.968996 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:45:14.968786 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:45:16.079179 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:45:16.079875 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:45:16.104849 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:45:16.127645 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:45:29.097377 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:45:29.107311 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-40e0c73b-0f3b-4ca1-9903-acabecb1e153 req-5bd716ea-6607-41a0-be41-ee316d549ad5 tempest-TestVolumeBootPattern-1489719531 None] Terminate volume connection completed successfully. Jul 30 21:45:29.107748 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-40e0c73b-0f3b-4ca1-9903-acabecb1e153 req-5bd716ea-6607-41a0-be41-ee316d549ad5 tempest-TestVolumeBootPattern-1489719531 None] Deleting attachment 7d90ccd5-bbde-45d0-8d93-03bdf549dbd3. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:45:30.676626 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-5412cf53-2389-453b-9c5e-00272002546c-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:45:30.685856 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-5412cf53-2389-453b-9c5e-00272002546c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:45:30.719406 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:45:30.792154 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:45:30.798203 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] deleting rbd volume volume-5412cf53-2389-453b-9c5e-00272002546c {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:45:30.995162 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] Created reservations ['e48ccd28-f37d-4cf8-938b-81c687f98216', 'aa707475-cb56-4726-91f6-4ee6a277507c', '50afa4d7-4a05-406e-99e5-e39096b6a833', '177db54a-3048-411c-ad0b-e2873b576669'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:45:31.042127 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:45:31.066029 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:45:31.090885 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:45:31.095229 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] Deleted volume successfully. Jul 30 21:45:31.107588 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-7af70582-e217-4bb0-9050-478f8d423c3f tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-5412cf53-2389-453b-9c5e-00272002546c-delete_volume" released by "delete_volume" :: held 0.422s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:45:31.815129 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-f9eb8411-af1b-4e89-ad89-23271346a377 tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-b964007e-fb6b-4f2a-8bea-0c2991535373-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:45:31.824300 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-f9eb8411-af1b-4e89-ad89-23271346a377 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-b964007e-fb6b-4f2a-8bea-0c2991535373-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:45:31.825924 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f9eb8411-af1b-4e89-ad89-23271346a377 tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:45:44.979380 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=23,cinder:UPDATE=7,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:01.926133 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:01.970183 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-f9eb8411-af1b-4e89-ad89-23271346a377 tempest-TestVolumeBootPattern-1489719531 None] Created reservations ['84a47467-a463-463a-8d84-a34c7c2c87d7', '6080b569-35b1-4578-89f7-9d9c311ff749', '82a31d48-c564-47b4-b3a1-8f4750f57257', '1c4f1055-8587-46cb-a8df-a01055804767'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:46:02.008588 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f9eb8411-af1b-4e89-ad89-23271346a377 tempest-TestVolumeBootPattern-1489719531 None] Delete snapshot completed successfully. Jul 30 21:46:02.013385 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-f9eb8411-af1b-4e89-ad89-23271346a377 tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-b964007e-fb6b-4f2a-8bea-0c2991535373-delete_snapshot" released by "delete_snapshot" :: held 30.189s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:46:05.752024 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-c4bf5041-484d-49a4-a75e-acec6fe2d674 req-da752464-8fc9-408c-8f35-cc9f05b9e46c tempest-TestVolumeBootPattern-1489719531 None] Terminate volume connection completed successfully. Jul 30 21:46:05.752713 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-c4bf5041-484d-49a4-a75e-acec6fe2d674 req-da752464-8fc9-408c-8f35-cc9f05b9e46c tempest-TestVolumeBootPattern-1489719531 None] Deleting attachment f2ba8596-2224-4314-971f-d21f6d76a7d1. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:46:07.856464 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] Acquiring lock "cinder-2d47a2ac-e152-4e83-b953-0485a902e560-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:46:07.864753 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-2d47a2ac-e152-4e83-b953-0485a902e560-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:46:07.898132 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:46:07.957310 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:46:07.964403 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] deleting rbd volume volume-2d47a2ac-e152-4e83-b953-0485a902e560 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:46:08.149370 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 21:46:08.178242 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] deleting parent snapshot volume-2d47a2ac-e152-4e83-b953-0485a902e560.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 21:46:08.552230 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] Created reservations ['01348c91-dc1a-4a22-a49a-03073568d701', '81e34593-689e-451a-8cb9-a2e03d4f735a', 'e5d8072e-7453-4244-b024-c66eb30ecc48', '3c2c956d-636b-48ae-b1b8-17d1b289605f'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:46:08.596707 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:46:08.621670 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:46:08.646123 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:46:08.650884 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] Deleted volume successfully. Jul 30 21:46:08.662847 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-04329e58-e864-46f3-90a1-758d1d50274c tempest-TestVolumeBootPattern-1489719531 None] Lock "cinder-2d47a2ac-e152-4e83-b953-0485a902e560-delete_volume" released by "delete_volume" :: held 0.798s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:46:16.082450 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:46:16.083108 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:46:16.110844 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:46:16.145093 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:46:24.981577 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=26,cinder:INSERT=5,cinder:UPDATE=12 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:24.985624 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=27,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:46:54.988403 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:04.993462 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:16.079947 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:47:16.080654 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:47:16.103561 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:47:16.127946 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:47:25.000293 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:35.005924 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:55.013061 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:47:55.020878 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:15.016726 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:16.083099 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:48:16.083791 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:48:16.113484 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:48:16.145688 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:48:25.028622 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:35.029473 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:48:55.035940 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:05.043972 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:15.050755 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:16.082253 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:49:16.083005 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:49:16.108835 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:49:16.140484 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:49:35.055074 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:49:55.051686 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:05.055139 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:16.085039 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:50:16.086232 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:50:16.113591 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:50:16.138825 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:50:25.062561 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:45.075631 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:50:45.076284 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:05.071362 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:15.077949 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:16.084707 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:51:16.085369 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:51:16.109130 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:51:16.131715 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:51:35.085819 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:51:45.095948 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:05.101469 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:15.111333 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:16.086945 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:52:16.087667 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:52:16.116904 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:52:16.153655 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:52:35.112580 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:52:55.112333 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:15.119404 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:16.090170 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:53:16.090751 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:53:16.131898 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:53:16.163930 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:53:25.128435 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:45.130628 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:53:55.135971 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:07.051337 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:54:07.070855 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Flow 'volume_create_manager' (406aa87c-7142-4e3c-bd6b-cf8559009053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:54:07.077320 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a27ffd-192b-4a26-9a13-4b09b59a9546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:54:07.093350 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a27ffd-192b-4a26-9a13-4b09b59a9546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1355243527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=46bb72b4-caf4-4b4f-909b-93b09cc1d58f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5d85194b3a4a05bd1e5e1af89e5acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:54:07Z,use_quota=True,user_id='bbfd9b97c2004392b2f32631352d95fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:54:07.098600 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a33922-8646-4e61-abfa-f4c333fdfd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:54:07.102612 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a33922-8646-4e61-abfa-f4c333fdfd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:54:07.107631 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5e43a3-827b-4001-8b15-46c8dea35d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:54:07.112284 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5e43a3-827b-4001-8b15-46c8dea35d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'volume_name': 'volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:54:07.117046 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d515a0ea-a72f-4332-b38e-abb508e31e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:54:07.120863 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d515a0ea-a72f-4332-b38e-abb508e31e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:54:07.125484 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5688c215-33b8-4583-8805-2b47a4c2e710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:54:07.126531 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Volume 46bb72b4-caf4-4b4f-909b-93b09cc1d58f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'volume_size': 1} Jul 30 21:54:07.126932 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] creating volume 'volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:54:07.127708 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:54:07.176177 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:54:07.176581 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:54:07.180211 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5688c215-33b8-4583-8805-2b47a4c2e710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:54:07.184730 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3ea6a4-49d0-45bf-b25e-8cd202fcf8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:54:07.193741 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Volume volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f (46bb72b4-caf4-4b4f-909b-93b09cc1d58f): created successfully Jul 30 21:54:07.197562 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3ea6a4-49d0-45bf-b25e-8cd202fcf8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:54:07.203429 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Flow 'volume_create_manager' (406aa87c-7142-4e3c-bd6b-cf8559009053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:54:07.210955 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-5150552e-0ffc-43c9-99d8-aabcc044fbcc tempest-ServerActionsTestJSON-1580867055 None] Created volume successfully. Jul 30 21:54:08.669374 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-15c5408b-3d58-483d-88e1-098c0ca54713 req-8bce8de6-1c30-4796-8ee1-ec4478be2ad3 tempest-ServerActionsTestJSON-1580867055 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:54:09.417304 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-15c5408b-3d58-483d-88e1-098c0ca54713 req-8bce8de6-1c30-4796-8ee1-ec4478be2ad3 tempest-ServerActionsTestJSON-1580867055 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.748s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:54:09.418128 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-15c5408b-3d58-483d-88e1-098c0ca54713 req-8bce8de6-1c30-4796-8ee1-ec4478be2ad3 tempest-ServerActionsTestJSON-1580867055 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:54:09.443630 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-15c5408b-3d58-483d-88e1-098c0ca54713 req-8bce8de6-1c30-4796-8ee1-ec4478be2ad3 tempest-ServerActionsTestJSON-1580867055 None] Connection info returned from driver {'name': 'volumes/volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1f0b13ca-7b4b-4724-8ce1-649e3016fd16'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:54:09.490131 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-15c5408b-3d58-483d-88e1-098c0ca54713 req-8bce8de6-1c30-4796-8ee1-ec4478be2ad3 tempest-ServerActionsTestJSON-1580867055 None] attachment_update completed successfully. Jul 30 21:54:15.144090 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=24,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:16.088071 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:54:16.088978 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:54:16.116201 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:54:16.142041 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:54:25.155089 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:40.361434 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-7d237604-86a3-4114-a9d9-a169158112a2 req-e2d83aa5-f34a-4277-a513-8848947c3098 tempest-ServerActionsTestJSON-1580867055 None] Terminate volume connection completed successfully. Jul 30 21:54:40.362147 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-7d237604-86a3-4114-a9d9-a169158112a2 req-e2d83aa5-f34a-4277-a513-8848947c3098 tempest-ServerActionsTestJSON-1580867055 None] Deleting attachment 1f0b13ca-7b4b-4724-8ce1-649e3016fd16. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:54:42.550511 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-7d237604-86a3-4114-a9d9-a169158112a2 req-9d8d3fe9-40db-4e07-9a50-4d157560d073 tempest-ServerActionsTestJSON-1580867055 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:54:43.302177 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-7d237604-86a3-4114-a9d9-a169158112a2 req-9d8d3fe9-40db-4e07-9a50-4d157560d073 tempest-ServerActionsTestJSON-1580867055 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.751s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:54:43.303197 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-7d237604-86a3-4114-a9d9-a169158112a2 req-9d8d3fe9-40db-4e07-9a50-4d157560d073 tempest-ServerActionsTestJSON-1580867055 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:54:43.327201 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-7d237604-86a3-4114-a9d9-a169158112a2 req-9d8d3fe9-40db-4e07-9a50-4d157560d073 tempest-ServerActionsTestJSON-1580867055 None] Connection info returned from driver {'name': 'volumes/volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '047c096c-920e-4b7a-8a10-82c1f2fa64f8'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:54:43.379576 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-7d237604-86a3-4114-a9d9-a169158112a2 req-9d8d3fe9-40db-4e07-9a50-4d157560d073 tempest-ServerActionsTestJSON-1580867055 None] attachment_update completed successfully. Jul 30 21:54:49.052981 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=24,cinder:UPDATE=5 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:49.056581 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-da1c16db-2bcb-4c62-af62-70507684ef84 req-681010ad-aa8b-4446-9d0f-1fc0fcfb8fc2 tempest-ServerActionsTestJSON-1580867055 None] Terminate volume connection completed successfully. Jul 30 21:54:49.056999 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-da1c16db-2bcb-4c62-af62-70507684ef84 req-681010ad-aa8b-4446-9d0f-1fc0fcfb8fc2 tempest-ServerActionsTestJSON-1580867055 None] Deleting attachment 047c096c-920e-4b7a-8a10-82c1f2fa64f8. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:54:51.164782 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-da1c16db-2bcb-4c62-af62-70507684ef84 req-1a1548ab-67b7-4af9-9689-e86a65ee7e24 tempest-ServerActionsTestJSON-1580867055 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:54:51.909006 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-da1c16db-2bcb-4c62-af62-70507684ef84 req-1a1548ab-67b7-4af9-9689-e86a65ee7e24 tempest-ServerActionsTestJSON-1580867055 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.744s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:54:51.909816 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-da1c16db-2bcb-4c62-af62-70507684ef84 req-1a1548ab-67b7-4af9-9689-e86a65ee7e24 tempest-ServerActionsTestJSON-1580867055 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:54:51.934654 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-da1c16db-2bcb-4c62-af62-70507684ef84 req-1a1548ab-67b7-4af9-9689-e86a65ee7e24 tempest-ServerActionsTestJSON-1580867055 None] Connection info returned from driver {'name': 'volumes/volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '46bb72b4-caf4-4b4f-909b-93b09cc1d58f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3eb70a24-f762-41e0-b20a-d8fab9aaf0e5'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:54:51.981744 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-da1c16db-2bcb-4c62-af62-70507684ef84 req-1a1548ab-67b7-4af9-9689-e86a65ee7e24 tempest-ServerActionsTestJSON-1580867055 None] attachment_update completed successfully. Jul 30 21:54:58.477227 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=28,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:54:58.481186 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-3d579a07-6004-48cf-a694-9ece2e58bc9f req-3f61fd07-72b6-4371-9bbc-c873094c1fea tempest-ServerActionsTestJSON-1580867055 None] Terminate volume connection completed successfully. Jul 30 21:54:58.481604 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-3d579a07-6004-48cf-a694-9ece2e58bc9f req-3f61fd07-72b6-4371-9bbc-c873094c1fea tempest-ServerActionsTestJSON-1580867055 None] Deleting attachment 3eb70a24-f762-41e0-b20a-d8fab9aaf0e5. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 21:54:59.409918 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] Acquiring lock "cinder-46bb72b4-caf4-4b4f-909b-93b09cc1d58f-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:54:59.425272 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] Lock "cinder-46bb72b4-caf4-4b4f-909b-93b09cc1d58f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:54:59.459676 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:54:59.511052 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 21:54:59.511870 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] Volume volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 21:54:59.516644 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] deleting rbd volume volume-46bb72b4-caf4-4b4f-909b-93b09cc1d58f {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 21:54:59.700669 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] Created reservations ['929fb0a6-5b8d-4bb8-9962-a69266128103', '661c5e5c-aede-4ee5-82d4-842ab6973f44', '8e494bca-42a5-4fd7-be99-e95ca4bb995f', '7929968f-cdc1-4994-b39f-65e7dfc98297'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:54:59.750167 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:54:59.775823 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:54:59.800441 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:54:59.804745 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] Deleted volume successfully. Jul 30 21:54:59.816845 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-48ff731a-0bf2-489b-900f-d1416fd48d27 tempest-ServerActionsTestJSON-1580867055 None] Lock "cinder-46bb72b4-caf4-4b4f-909b-93b09cc1d58f-delete_volume" released by "delete_volume" :: held 0.392s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:55:15.161395 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=26,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:16.088062 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:55:16.088790 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:55:16.112290 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:55:16.146549 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:55:35.161386 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=20,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:55:55.172209 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:05.175880 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:16.092195 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:56:16.096089 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:56:16.176415 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:56:16.226518 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:56:25.173954 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:42.563651 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 21:56:42.583142 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Flow 'volume_create_manager' (24e1519b-9687-4872-a618-a464f4bf86b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:56:42.589433 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569ad4f3-dbbd-45cb-bc64-0cee992e2279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:56:42.593537 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:56:42.605102 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569ad4f3-dbbd-45cb-bc64-0cee992e2279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T21:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-889319575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8a544a4d-80a9-4e05-9364-dd5949ad2b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9d01d869a84e2486ef3918ff0dc1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T21:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T21:56:43Z,use_quota=True,user_id='cdd6e3798b5c4086ba6c1ccf22cbbb17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:56:42.610243 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a566551-d220-498c-b9d8-d5b9ae41d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:56:42.614196 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a566551-d220-498c-b9d8-d5b9ae41d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:56:42.619065 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fecd303-8bb4-4be9-a772-83dce01995c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:56:42.623510 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fecd303-8bb4-4be9-a772-83dce01995c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a544a4d-80a9-4e05-9364-dd5949ad2b66', 'volume_name': 'volume-8a544a4d-80a9-4e05-9364-dd5949ad2b66', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:56:42.628182 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9074183-8c6e-4a81-b58a-732f503cf6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:56:42.631943 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9074183-8c6e-4a81-b58a-732f503cf6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:56:42.636429 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2acaf3b3-b93a-4eaf-bfbf-a9ccae307872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:56:42.638035 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Volume 8a544a4d-80a9-4e05-9364-dd5949ad2b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a544a4d-80a9-4e05-9364-dd5949ad2b66', 'volume_size': 1} Jul 30 21:56:42.638422 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] creating volume 'volume-8a544a4d-80a9-4e05-9364-dd5949ad2b66' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 21:56:42.639161 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:56:42.745320 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 21:56:42.745642 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 21:56:42.749889 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2acaf3b3-b93a-4eaf-bfbf-a9ccae307872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a544a4d-80a9-4e05-9364-dd5949ad2b66', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:56:42.754311 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5ba488-0b94-44a7-b013-adb134b27edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 21:56:42.762968 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Volume volume-8a544a4d-80a9-4e05-9364-dd5949ad2b66 (8a544a4d-80a9-4e05-9364-dd5949ad2b66): created successfully Jul 30 21:56:42.766353 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5ba488-0b94-44a7-b013-adb134b27edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 21:56:42.771935 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Flow 'volume_create_manager' (24e1519b-9687-4872-a618-a464f4bf86b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 21:56:42.779471 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-f0f783d2-d944-46f7-b124-fe26e9f8b844 tempest-TestMinimumBasicScenario-2039972807 None] Created volume successfully. Jul 30 21:56:44.155889 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 req-e091b6e4-0927-426e-8269-3ea10e36dee6 tempest-TestMinimumBasicScenario-2039972807 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 21:56:45.168207 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 req-e091b6e4-0927-426e-8269-3ea10e36dee6 tempest-TestMinimumBasicScenario-2039972807 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.012s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 21:56:45.169173 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 req-e091b6e4-0927-426e-8269-3ea10e36dee6 tempest-TestMinimumBasicScenario-2039972807 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8a544a4d-80a9-4e05-9364-dd5949ad2b66', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '8a544a4d-80a9-4e05-9364-dd5949ad2b66', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 21:56:45.201406 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 req-e091b6e4-0927-426e-8269-3ea10e36dee6 tempest-TestMinimumBasicScenario-2039972807 None] Connection info returned from driver {'name': 'volumes/volume-8a544a4d-80a9-4e05-9364-dd5949ad2b66', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8a544a4d-80a9-4e05-9364-dd5949ad2b66', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '80f18f5e-36cb-48f3-b1aa-041b7c2877a8'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 21:56:45.248217 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-a588b27a-d8f4-4e89-b7c8-f42483e40d02 req-e091b6e4-0927-426e-8269-3ea10e36dee6 tempest-TestMinimumBasicScenario-2039972807 None] attachment_update completed successfully. Jul 30 21:56:47.493026 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-93141f94-dd52-481e-9b16-4f6973ff08ca tempest-TestMinimumBasicScenario-2039972807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:56:48.357884 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-93141f94-dd52-481e-9b16-4f6973ff08ca tempest-TestMinimumBasicScenario-2039972807 None] Create snapshot completed successfully Jul 30 21:57:05.184035 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=25,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:57:15.189383 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=26,cinder:UPDATE=5 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:57:16.097049 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:57:16.097762 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:57:16.122383 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:57:16.146434 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:57:35.198537 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:57:45.203361 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:58:05.212970 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:58:15.213947 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:58:16.102239 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:58:16.102948 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:58:16.134152 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:58:16.161976 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:58:35.214677 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:58:37.549185 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bcc42fa9-746d-4808-a0ec-2f50564baa28 tempest-TestMinimumBasicScenario-2039972807 None] Acquiring lock "cinder-4037139c-d2d2-4283-b362-6b165365b49e-delete_snapshot" by "delete_snapshot" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 21:58:37.558624 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bcc42fa9-746d-4808-a0ec-2f50564baa28 tempest-TestMinimumBasicScenario-2039972807 None] Lock "cinder-4037139c-d2d2-4283-b362-6b165365b49e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 21:58:37.560154 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-bcc42fa9-746d-4808-a0ec-2f50564baa28 tempest-TestMinimumBasicScenario-2039972807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:58:45.218313 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:05.223620 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:07.679732 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-bcc42fa9-746d-4808-a0ec-2f50564baa28 tempest-TestMinimumBasicScenario-2039972807 None] Created reservations ['16d51b4b-792e-4c53-b927-10d89440aca5', 'a5538ae6-ec06-41ea-8eff-2c52e67a86cb', '84eb9a9c-3607-4017-ac9f-28426e139870', '248814fb-2c1b-4082-9e4a-31fe477a3bac'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 21:59:07.715269 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-bcc42fa9-746d-4808-a0ec-2f50564baa28 tempest-TestMinimumBasicScenario-2039972807 None] Delete snapshot completed successfully. Jul 30 21:59:07.720027 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-bcc42fa9-746d-4808-a0ec-2f50564baa28 tempest-TestMinimumBasicScenario-2039972807 None] Lock "cinder-4037139c-d2d2-4283-b362-6b165365b49e-delete_snapshot" released by "delete_snapshot" :: held 30.161s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 21:59:15.237839 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=18,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:16.107443 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 21:59:16.108529 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:59:16.132019 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 21:59:16.156161 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 21:59:35.241399 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 21:59:45.246872 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:05.254487 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:15.262343 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:16.111944 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:00:16.112654 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:00:16.137592 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:00:16.165368 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:00:25.267325 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:00:26.471942 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-964595ae-9c07-4178-bb6a-79737afab63e req-31a146c9-9f01-44b4-a5b3-7625d7fcf833 tempest-TestMinimumBasicScenario-2039972807 None] Terminate volume connection completed successfully. Jul 30 22:00:26.472638 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-964595ae-9c07-4178-bb6a-79737afab63e req-31a146c9-9f01-44b4-a5b3-7625d7fcf833 tempest-TestMinimumBasicScenario-2039972807 None] Deleting attachment 80f18f5e-36cb-48f3-b1aa-041b7c2877a8. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 22:00:27.108223 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] Acquiring lock "cinder-8a544a4d-80a9-4e05-9364-dd5949ad2b66-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 22:00:27.117801 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] Lock "cinder-8a544a4d-80a9-4e05-9364-dd5949ad2b66-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 22:00:27.152718 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:00:27.194342 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 22:00:27.194832 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] Volume volume-8a544a4d-80a9-4e05-9364-dd5949ad2b66 is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 22:00:27.198775 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] deleting rbd volume volume-8a544a4d-80a9-4e05-9364-dd5949ad2b66 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 22:00:27.362773 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] Created reservations ['b5b167e9-0002-4da6-afae-f42a9af142bf', 'bf782c87-b417-418d-8461-604aba172d44', 'b9203430-28e4-4b0d-88ef-ffa28c6058ce', '25498e7a-d941-4b3f-ab85-a9af72f76313'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 22:00:27.407974 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:00:27.430672 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:00:27.457765 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:00:27.463137 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] Deleted volume successfully. Jul 30 22:00:27.475123 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-3095984e-4598-4af8-9657-e7a7325f1070 tempest-TestMinimumBasicScenario-2039972807 None] Lock "cinder-8a544a4d-80a9-4e05-9364-dd5949ad2b66-delete_volume" released by "delete_volume" :: held 0.357s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 22:00:55.265628 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=23,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:00.400075 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:00.409696 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 22:01:00.430869 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Flow 'volume_create_manager' (23de589c-0f92-4e0e-b2be-4ae9482bc9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 22:01:00.437866 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c87bd4c-8f76-4fc2-bbda-eac1871379a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:01:00.454663 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c87bd4c-8f76-4fc2-bbda-eac1871379a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T22:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-172258482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=12ae76c0-983e-45df-a358-65d6bb45a5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9d01d869a84e2486ef3918ff0dc1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T22:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T22:01:00Z,use_quota=True,user_id='cdd6e3798b5c4086ba6c1ccf22cbbb17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:01:00.459974 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cced0d-310b-425a-aba4-64fa0a9bd1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:01:00.464058 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cced0d-310b-425a-aba4-64fa0a9bd1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:01:00.469063 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ad490d-4fc7-4641-a43b-19f5b1adda39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:01:00.473702 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ad490d-4fc7-4641-a43b-19f5b1adda39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ae76c0-983e-45df-a358-65d6bb45a5ce', 'volume_name': 'volume-12ae76c0-983e-45df-a358-65d6bb45a5ce', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:01:00.478516 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fda3a73-29f4-4665-862e-a64bd4421132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:01:00.482374 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fda3a73-29f4-4665-862e-a64bd4421132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:01:00.486995 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746bf339-e68c-4660-8464-36cd8f933383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:01:00.488069 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Volume 12ae76c0-983e-45df-a358-65d6bb45a5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ae76c0-983e-45df-a358-65d6bb45a5ce', 'volume_size': 1} Jul 30 22:01:00.488464 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] creating volume 'volume-12ae76c0-983e-45df-a358-65d6bb45a5ce' {{(pid=124008) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jul 30 22:01:00.489221 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:01:00.540418 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 22:01:00.540694 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 22:01:00.544327 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746bf339-e68c-4660-8464-36cd8f933383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ae76c0-983e-45df-a358-65d6bb45a5ce', 'volume_size': 1}' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:01:00.549151 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d594775-91f7-4b22-ad10-0b821ce43ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:01:00.559662 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Volume volume-12ae76c0-983e-45df-a358-65d6bb45a5ce (12ae76c0-983e-45df-a358-65d6bb45a5ce): created successfully Jul 30 22:01:00.563262 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d594775-91f7-4b22-ad10-0b821ce43ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:01:00.568877 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Flow 'volume_create_manager' (23de589c-0f92-4e0e-b2be-4ae9482bc9ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 22:01:00.577157 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-9a91b7d2-88ca-4858-acb8-715dc3afe1aa tempest-TestMinimumBasicScenario-2039972807 None] Created volume successfully. Jul 30 22:01:01.974250 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-4a181cd8-1fd1-4e50-8406-a6b719085b11 req-f75df3c8-7ee5-470d-92fa-d60626593285 tempest-TestMinimumBasicScenario-2039972807 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 22:01:02.808998 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-4a181cd8-1fd1-4e50-8406-a6b719085b11 req-f75df3c8-7ee5-470d-92fa-d60626593285 tempest-TestMinimumBasicScenario-2039972807 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.834s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 22:01:02.810139 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-4a181cd8-1fd1-4e50-8406-a6b719085b11 req-f75df3c8-7ee5-470d-92fa-d60626593285 tempest-TestMinimumBasicScenario-2039972807 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-12ae76c0-983e-45df-a358-65d6bb45a5ce', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': '12ae76c0-983e-45df-a358-65d6bb45a5ce', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 22:01:02.834046 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-4a181cd8-1fd1-4e50-8406-a6b719085b11 req-f75df3c8-7ee5-470d-92fa-d60626593285 tempest-TestMinimumBasicScenario-2039972807 None] Connection info returned from driver {'name': 'volumes/volume-12ae76c0-983e-45df-a358-65d6bb45a5ce', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '12ae76c0-983e-45df-a358-65d6bb45a5ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '516bfd3c-490f-4cdf-9810-07f237d35431'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 22:01:02.881153 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-4a181cd8-1fd1-4e50-8406-a6b719085b11 req-f75df3c8-7ee5-470d-92fa-d60626593285 tempest-TestMinimumBasicScenario-2039972807 None] attachment_update completed successfully. Jul 30 22:01:16.111060 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:01:16.112028 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:01:16.137633 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:01:16.162284 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:01:25.274487 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=12 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:25.282313 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=25,cinder:UPDATE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:45.274744 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:01:55.282335 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:05.283684 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:16.107790 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:02:16.108669 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:02:16.139127 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:02:16.163525 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:02:25.296875 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:02:26.056368 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-17e41e20-3d10-4277-9ed9-add5d806a7bb req-f3968816-81c4-4b73-ad0a-bc5473f79341 tempest-TestMinimumBasicScenario-2039972807 None] Terminate volume connection completed successfully. Jul 30 22:02:26.056773 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-17e41e20-3d10-4277-9ed9-add5d806a7bb req-f3968816-81c4-4b73-ad0a-bc5473f79341 tempest-TestMinimumBasicScenario-2039972807 None] Deleting attachment 516bfd3c-490f-4cdf-9810-07f237d35431. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 22:02:26.672848 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] Acquiring lock "cinder-12ae76c0-983e-45df-a358-65d6bb45a5ce-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 22:02:26.682335 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] Lock "cinder-12ae76c0-983e-45df-a358-65d6bb45a5ce-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 22:02:26.714970 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:02:26.755395 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 22:02:26.755853 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] Volume volume-12ae76c0-983e-45df-a358-65d6bb45a5ce is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 22:02:26.760567 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] deleting rbd volume volume-12ae76c0-983e-45df-a358-65d6bb45a5ce {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 22:02:26.925615 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] Created reservations ['392192f7-b06b-40b7-a1bc-98566e559485', '3ceb87cf-ff19-47dc-a05d-75dd92862891', 'e1897ca6-73b7-47a2-9f55-e644c2d690b3', 'b3f9402d-5a93-4bd4-a0b5-754af212e73c'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 22:02:26.968639 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:02:26.992816 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:02:27.020901 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:02:27.024915 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] Deleted volume successfully. Jul 30 22:02:27.036903 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-fe1502b4-5502-4ee8-9b4c-74aaaffc4dcb tempest-TestMinimumBasicScenario-2039972807 None] Lock "cinder-12ae76c0-983e-45df-a358-65d6bb45a5ce-delete_volume" released by "delete_volume" :: held 0.355s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 22:02:45.297319 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=22,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:05.301502 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:15.312303 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:16.109354 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:03:16.110008 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:03:16.132596 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:03:16.155668 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:03:35.315669 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:35.318665 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:03:55.309531 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:05.316399 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:16.111834 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:04:16.112496 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:04:16.146819 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:04:16.182569 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:04:25.327069 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:35.329465 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:04:55.335820 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:05.338214 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:15.332729 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:16.107209 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:05:16.107894 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:05:16.132855 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:05:16.156387 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:05:25.348286 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:35.346906 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:05:55.354850 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:05.357758 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:16.111034 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:06:16.111758 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:06:16.138750 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:06:16.164610 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:06:25.358143 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:35.366603 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:06:55.362371 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:05.368423 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:16.110056 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:07:16.110838 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:07:16.136775 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:07:16.166619 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:07:25.376351 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:35.384147 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:07:55.387075 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:05.388996 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:16.112181 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:08:16.112843 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:08:16.138648 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:08:16.166175 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:08:25.387979 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:35.391445 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:55.392357 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:08:55.396272 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:15.403119 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:15.412061 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:16.111620 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:09:16.112280 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:09:16.161348 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:09:16.199730 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:09:35.391199 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:55.389861 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:09:55.390523 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:15.389599 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:16.115014 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:10:16.115968 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:10:16.160866 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:10:16.192287 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:10:25.391893 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:10:45.400649 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:11:05.401550 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:11:16.113467 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:11:16.114149 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:11:16.137813 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:11:16.162148 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:11:25.408148 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:11:35.410815 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:11:55.418066 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:12:15.424929 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:12:15.425621 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:12:16.117213 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:12:16.117870 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:12:16.147219 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:12:16.176722 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:12:35.435179 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:12:45.438796 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:05.448268 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:16.121968 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:13:16.122593 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:13:16.145477 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:13:16.171053 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:13:25.449655 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:35.460728 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:13:55.461443 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:05.472925 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:16.127511 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:14:16.128276 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:14:16.161494 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:14:16.186572 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:14:25.472214 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:35.482094 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:37.275646 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}} Jul 30 22:14:37.294555 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Flow 'volume_create_manager' (daffb47f-5456-485b-8ff8-f06e50a0782c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 22:14:37.300813 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5846ef-0312-4afa-8ee7-6cf3d3c4eb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:14:37.316403 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5846ef-0312-4afa-8ee7-6cf3d3c4eb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-07-30T22:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-623147504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f42faa96-6987-42a1-b293-48f11aaae816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0d987d5adc45fbb03290b133ee0641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-07-30T22:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-07-30T22:14:37Z,use_quota=True,user_id='eba4265a2b324928b7aee20262b850fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d439f1dc-772a-428f-8236-70686e2bf484),volume_type_id=d439f1dc-772a-428f-8236-70686e2bf484)' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:14:37.321485 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acf3247-d343-4bd2-b717-858219a6108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:14:37.326063 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acf3247-d343-4bd2-b717-858219a6108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:14:37.330916 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b56db2-bf05-403e-8ac9-308c2ba5a70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:14:37.409539 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b56db2-bf05-403e-8ac9-308c2ba5a70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f42faa96-6987-42a1-b293-48f11aaae816', 'volume_name': 'volume-f42faa96-6987-42a1-b293-48f11aaae816', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:14:37.414298 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6215dd-ffde-4f8d-8f40-ed26dbca7c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:14:37.418145 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6215dd-ffde-4f8d-8f40-ed26dbca7c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:14:37.422641 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3918a5-7cf0-4d1d-a052-b56553a89dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:14:37.423743 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Volume f42faa96-6987-42a1-b293-48f11aaae816: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f42faa96-6987-42a1-b293-48f11aaae816', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 22:14:37.424299 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Cloning f42faa96-6987-42a1-b293-48f11aaae816 from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd at location (None, None). {{(pid=124008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}} Jul 30 22:14:37.425015 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Acquiring lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" by "_prepare_image_cache_entry" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 22:14:37.433192 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 22:14:37.443442 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 22, 14, 37, 438019)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 22:14:37.443871 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 22:14:37.444262 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Found cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}} Jul 30 22:14:37.448796 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Lock "cinder-991d1dec-81bf-4a5b-923e-56f2270c6dfd" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 22:14:37.449704 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Attempting to retrieve cache entry for image = 991d1dec-81bf-4a5b-923e-56f2270c6dfd on host ncdv-master-1@ceph#ceph. {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Jul 30 22:14:37.455233 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Found image-volume cache entry: {'id': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'volume_id': 'e87262ec-313f-4770-82fa-2a4c46fee6ca', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15), 'last_used': datetime.datetime(2022, 7, 30, 22, 14, 37, 453035)}. {{(pid=124008) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jul 30 22:14:37.455692 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.image.cache [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Image-volume cache entry image_update_at = 2022-07-30 20:51:15+00:00, requested image updated_at = 2022-07-30 20:51:15+00:00. {{(pid=124008) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jul 30 22:14:37.456112 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Creating from source image-volume e87262ec-313f-4770-82fa-2a4c46fee6ca {{(pid=124008) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}} Jul 30 22:14:37.469926 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:14:37.535982 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] creating snapshot='volume-f42faa96-6987-42a1-b293-48f11aaae816.clone_snap' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jul 30 22:14:37.879031 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] cloning 'volume-e87262ec-313f-4770-82fa-2a4c46fee6ca@volume-f42faa96-6987-42a1-b293-48f11aaae816.clone_snap' to 'volume-f42faa96-6987-42a1-b293-48f11aaae816' {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jul 30 22:14:38.016163 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Volume volume-1941c452-ad85-49ec-b06a-60721b5e727b.deleted is not a clone. {{(pid=124008) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jul 30 22:14:38.017346 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jul 30 22:14:38.017716 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124008) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jul 30 22:14:38.033148 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] clone created successfully {{(pid=124008) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jul 30 22:14:38.033772 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.volume_utils [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Marking volume f42faa96-6987-42a1-b293-48f11aaae816 as bootable. {{(pid=124008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Jul 30 22:14:38.042580 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Copying metadata from image 991d1dec-81bf-4a5b-923e-56f2270c6dfd to f42faa96-6987-42a1-b293-48f11aaae816. {{(pid=124008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jul 30 22:14:38.043111 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.flows.manager.create_volume [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Creating volume glance metadata for volume f42faa96-6987-42a1-b293-48f11aaae816 backed by image 991d1dec-81bf-4a5b-923e-56f2270c6dfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}} Jul 30 22:14:38.094967 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3918a5-7cf0-4d1d-a052-b56553a89dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42faa96-6987-42a1-b293-48f11aaae816', 'volume_size': 1, 'image_id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375d034049af46779b4f307bede15a89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '991d1dec-81bf-4a5b-923e-56f2270c6dfd', 'created_at': datetime.datetime(2022, 7, 30, 20, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 7, 30, 20, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991d1dec-81bf-4a5b-923e-56f2270c6dfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:14:38.099460 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940fd59b-f3de-4ab0-b054-5d735f568e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 30 22:14:38.108130 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.flows.manager.create_volume [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Volume volume-f42faa96-6987-42a1-b293-48f11aaae816 (f42faa96-6987-42a1-b293-48f11aaae816): created successfully Jul 30 22:14:38.111462 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940fd59b-f3de-4ab0-b054-5d735f568e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124008) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 30 22:14:38.116667 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Flow 'volume_create_manager' (daffb47f-5456-485b-8ff8-f06e50a0782c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124008) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 30 22:14:38.124080 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [None req-777c55ce-6546-4653-bac9-2ad26eac4b79 tempest-TestShelveInstance-1765977873 None] Created volume successfully. Jul 30 22:14:40.146158 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-f4c54947-c4d9-4883-86d4-94b180e45490 req-42d98d31-b952-4959-908e-95788009af38 tempest-TestShelveInstance-1765977873 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 22:14:40.912378 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-f4c54947-c4d9-4883-86d4-94b180e45490 req-42d98d31-b952-4959-908e-95788009af38 tempest-TestShelveInstance-1765977873 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.765s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 22:14:40.912989 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-f4c54947-c4d9-4883-86d4-94b180e45490 req-42d98d31-b952-4959-908e-95788009af38 tempest-TestShelveInstance-1765977873 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f42faa96-6987-42a1-b293-48f11aaae816', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'f42faa96-6987-42a1-b293-48f11aaae816', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 22:14:40.938906 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-f4c54947-c4d9-4883-86d4-94b180e45490 req-42d98d31-b952-4959-908e-95788009af38 tempest-TestShelveInstance-1765977873 None] Connection info returned from driver {'name': 'volumes/volume-f42faa96-6987-42a1-b293-48f11aaae816', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f42faa96-6987-42a1-b293-48f11aaae816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0abbb9d6-7665-4216-9ced-d2cf93e8985a'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 22:14:40.990059 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-f4c54947-c4d9-4883-86d4-94b180e45490 req-42d98d31-b952-4959-908e-95788009af38 tempest-TestShelveInstance-1765977873 None] attachment_update completed successfully. Jul 30 22:14:55.484298 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=24,cinder:UPDATE=7,cinder:INSERT=7 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:14:55.484992 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=33,cinder:UPDATE=4,cinder:INSERT=5,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:15:16.132114 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:15:16.133028 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:15:16.159675 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:15:16.184391 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:15:25.500172 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:15:25.503683 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:15:45.497072 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:15:55.500658 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:16:15.507829 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:16:16.129611 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:16:16.130269 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:16:16.160406 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:16:16.189882 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:16:25.513619 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:16:55.515058 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:16:55.523410 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:17:11.369706 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-889993cc-1f70-482e-b337-c5131069d8a5 req-e795d82e-6cc0-46a5-bfac-ae8c6577b615 tempest-TestShelveInstance-1765977873 None] Terminate volume connection completed successfully. Jul 30 22:17:11.370388 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-889993cc-1f70-482e-b337-c5131069d8a5 req-e795d82e-6cc0-46a5-bfac-ae8c6577b615 tempest-TestShelveInstance-1765977873 None] Deleting attachment 0abbb9d6-7665-4216-9ced-d2cf93e8985a. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 22:17:13.533620 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 req-55c56861-cc7f-41ed-8fc1-f735ffa3c80f tempest-TestShelveInstance-1765977873 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 30 22:17:14.272160 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_concurrency.processutils [req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 req-55c56861-cc7f-41ed-8fc1-f735ffa3c80f tempest-TestShelveInstance-1765977873 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.738s {{(pid=124008) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 30 22:17:14.272968 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 req-55c56861-cc7f-41ed-8fc1-f735ffa3c80f tempest-TestShelveInstance-1765977873 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f42faa96-6987-42a1-b293-48f11aaae816', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '25108750-09ba-4fb8-b2b1-158df8723c2e', 'volume_id': 'f42faa96-6987-42a1-b293-48f11aaae816', 'discard': True}} {{(pid=124008) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jul 30 22:17:14.298926 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 req-55c56861-cc7f-41ed-8fc1-f735ffa3c80f tempest-TestShelveInstance-1765977873 None] Connection info returned from driver {'name': 'volumes/volume-f42faa96-6987-42a1-b293-48f11aaae816', 'hosts': ['10.222.0.17'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f42faa96-6987-42a1-b293-48f11aaae816', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9430c79a-c61b-43a3-b1c5-f9b075a2cbd9'} {{(pid=124008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}} Jul 30 22:17:14.374463 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-03ef4f63-2b37-4ccd-b4b2-c42e57ac3c50 req-55c56861-cc7f-41ed-8fc1-f735ffa3c80f tempest-TestShelveInstance-1765977873 None] attachment_update completed successfully. Jul 30 22:17:16.135550 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:17:16.136448 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:17:16.163669 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:17:16.194826 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:17:35.520913 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=20,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:17:35.522515 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:05.521831 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:05.532497 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:25.531836 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:35.542589 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:18:45.456170 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-91ce645c-da2f-402e-812b-c943d39600ff tempest-TestShelveInstance-1765977873 None] Terminate volume connection completed successfully. Jul 30 22:18:45.456819 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.manager [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-91ce645c-da2f-402e-812b-c943d39600ff tempest-TestShelveInstance-1765977873 None] Deleting attachment 9430c79a-c61b-43a3-b1c5-f9b075a2cbd9. {{(pid=124008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}} Jul 30 22:18:45.569267 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] Acquiring lock "cinder-f42faa96-6987-42a1-b293-48f11aaae816-delete_volume" by "delete_volume" {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Jul 30 22:18:45.578877 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] Lock "cinder-f42faa96-6987-42a1-b293-48f11aaae816-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:195}} Jul 30 22:18:45.614015 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:18:45.688752 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] volume has no backup snaps {{(pid=124008) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jul 30 22:18:45.696292 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] deleting rbd volume volume-f42faa96-6987-42a1-b293-48f11aaae816 {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jul 30 22:18:45.926278 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] volume is a clone so cleaning references {{(pid=124008) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jul 30 22:18:45.955353 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] deleting parent snapshot volume-f42faa96-6987-42a1-b293-48f11aaae816.clone_snap {{(pid=124008) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jul 30 22:18:46.188340 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.quota [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] Created reservations ['2a3d88c7-8636-4384-be9e-4e910d11687e', 'd123dd2d-5db4-4906-950b-9df28687843b', '8c30321c-1720-4191-a268-39ea19694c80', '122f134c-6edb-48fa-a851-daaef4ecbaa3'] {{(pid=124008) reserve /opt/stack/cinder/cinder/quota.py:755}} Jul 30 22:18:46.230507 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:18:46.255041 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:18:46.280765 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:18:46.289292 ncdv-master-1 cinder-volume[124008]: INFO cinder.volume.manager [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] Deleted volume successfully. Jul 30 22:18:46.302471 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.coordination [req-ccca6622-e5f5-4adb-920d-299f5d9050b9 req-bf6d52b7-c1c7-4413-b58e-1e2af51f3822 tempest-TestShelveInstance-1765977873 None] Lock "cinder-f42faa96-6987-42a1-b293-48f11aaae816-delete_volume" released by "delete_volume" :: held 0.724s {{(pid=124008) _synchronized /opt/stack/cinder/cinder/coordination.py:204}} Jul 30 22:18:55.545861 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=20,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:05.556886 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=18,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:16.141638 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:19:16.142933 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:19:16.184488 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:19:16.218666 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:19:25.544764 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:35.550215 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:19:55.556784 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:20:15.555518 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:20:16.146178 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:20:16.146840 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:20:16.178056 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:20:16.202608 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:20:25.567762 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:20:45.568107 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:20:55.579269 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:15.581143 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:16.148325 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:21:16.149018 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:21:16.181004 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:21:16.206444 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:21:35.588625 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:21:45.592429 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:22:05.600413 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:22:15.604194 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:22:16.152040 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:22:16.152701 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:22:16.177345 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:22:16.206766 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:22:35.614017 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:22:45.616949 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:05.624224 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:05.626010 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:16.152960 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:23:16.153616 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:23:16.176984 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:23:16.201934 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:23:25.636536 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:35.636589 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:23:45.639516 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:24:05.646087 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:24:15.650478 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:24:16.156846 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:24:16.157537 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:24:16.199493 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:24:16.230435 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:24:35.653932 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:24:35.661347 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:24:55.666763 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:25:05.668538 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:25:16.156542 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:25:16.157200 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:25:16.180527 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:25:16.207355 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:25:25.672308 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:25:35.678236 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:25:55.685091 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:26:05.690073 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:26:16.153765 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:26:16.154534 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:26:16.183731 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:26:16.209534 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:26:25.698235 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:26:35.701849 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:26:55.702422 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:26:55.709941 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:27:16.154596 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:27:16.155252 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:27:16.178976 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:27:16.204462 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:27:25.712994 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:27:35.719179 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:27:55.725874 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:27:55.726630 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:28:15.737307 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:28:16.159597 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:28:16.160255 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:28:16.183045 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:28:16.211788 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:28:25.738922 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:28:45.748713 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:28:55.757041 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:29:15.756136 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:29:15.759908 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:29:16.156522 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:29:16.157176 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:29:16.180768 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:29:16.204493 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:29:25.767835 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:29:45.773001 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:30:05.774309 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:30:15.783880 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:30:16.159811 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:30:16.160460 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:30:16.183957 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:30:16.208156 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:30:35.775628 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:30:45.779064 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:31:05.787490 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:31:15.792530 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:31:16.163399 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:31:16.164054 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:31:16.186036 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:31:16.209222 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 30 22:31:35.801445 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:31:35.802129 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:32:05.808909 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:32:15.806298 ncdv-master-1 cinder-volume[124008]: DEBUG dbcounter [-] [124008] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124008) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 22:32:16.165504 ncdv-master-1 cinder-volume[124008]: DEBUG oslo_service.periodic_task [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124008) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 30 22:32:16.166168 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:32:16.190252 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.volume.drivers.rbd [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124008) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jul 30 22:32:16.216506 ncdv-master-1 cinder-volume[124008]: DEBUG cinder.manager [None req-517c9863-0a65-4b7a-8fac-62174df20ee0 None None] Notifying Schedulers of capabilities ... {{(pid=124008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}